00000001:02000400:0.0F:1787855585.806804:0:2961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787855606.791064:0:3181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1787855609.683706:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 383 MB/s 00000001:01000000:1.0F:1787855609.938064:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 561 MB/s 00000001:01000000:2.0:1787855610.187948:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3587 MB/s 00000020:02000000:0.0:1787855611.168203:0:3273:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_82_g33e568c 00000400:02000000:0.0:1787855612.447871:0:3288:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.138@tcp [8/256/0/180] 00008000:02000000:3.0:1787855617.007742:0:3438:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787855671.030300:0:5241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787855681.182620:0:5814:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787855681.182626:0:5814:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787855681.183196:0:5814:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000be390fe4 00000080:02000400:0.0:1787855681.183209:0:5814:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787855681.187960:0:5814:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787855681.187977:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787855681.188160:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000003973f2bd) 00000020:00000080:0.0:1787855681.188182:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787855681.205607:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787855681.206391:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787855681.250338:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787855681.250379:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787855681.250401:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787855681.250452:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787855681.250478:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787855681.257550:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787855681.257560:0:5814:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787855681.257572:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x516929ca3366d2b7 00000020:01000004:3.0:1787855681.257580:0:5814:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787855681.257585:0:5814:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787855681.257590:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000be390fe4 from MGS 00000020:01000004:3.0:1787855681.257594:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787855681.257617:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000001d7ce062) 00000020:00000080:3.0:1787855681.257629:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787855681.259294:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000be390fe4 from MGS, refs=2 00080000:01000000:3.0:1787855681.259309:0:5814:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787855681.259321:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x516929ca3366d2c5 00000100:00100000:3.0:1787855681.259467:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787855681.259625:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787855681.259631:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787855681.262384:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787855681.262400:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787855681.264231:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787855681.264421:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787855681.264426:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787855681.273901:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787855681.273918:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787855681.275878:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787855681.275889:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787855681.278092:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855681.278097:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855681.278099:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855681.279148:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855681.279151:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855681.279154:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855681.287722:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787855681.291733:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787855681.536988:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2843 MB/s 00000001:01000000:2.0:1787855681.786913:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4531 MB/s 00000001:01000000:0.0:1787855682.037577:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 639 MB/s 00000001:01000000:0.0:1787855682.288108:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 876 MB/s 00080000:10000000:0.0:1787855682.294873:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1787855682.300016:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787855682.309564:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787855682.309584:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787855682.309587:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787855682.312988:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787855682.313087:0:5814:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787855682.313144:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787855682.313577:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787855682.313604:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787855682.314028:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787855682.314180:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787855682.314186:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787855682.320483:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787855682.323936:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787855682.324289:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787855682.324297:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787855682.325153:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787855682.325175:0:5814:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.138@tcp' 00000020:01000004:2.0:1787855682.325177:0:5814:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787855682.325225:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.138@tcp (typ=mgc) 00000020:00000080:2.0:1787855682.325247:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.138@tcp (00000000fe065117) 00000020:00000080:2.0:1787855682.325263:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787855682.325386:0:5814:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f3cfce09@MGC192.168.201.138@tcp: add connection 192.168.201.138@tcp at head 00010000:00010000:2.0:1787855682.325559:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.138@tcp-0 is initialized 00000040:01000000:2.0:1787855682.325566:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787855682.327711:0:5829:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787855682.328296:0:5830:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787855682.330175:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.138@tcp (uuid b2adc339-cccb-4166-8f83-87a1e9e399f1) 00000020:00000080:2.0:1787855682.330201:0:5814:0:(genops.c:1385:class_connect()) connect: client b2adc339-cccb-4166-8f83-87a1e9e399f1, cookie 0x516929ca3366d2d3 00000100:00080000:2.0:1787855682.330211:0:5814:0:(import.c:510:import_select_connection()) MGC192.168.201.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787855682.330217:0:5814:0:(import.c:624:import_select_connection()) MGC192.168.201.138@tcp: import 00000000f3cfce09 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:2.0:1787855682.330247:0:5814:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000862ae46c x1874702486208640/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787855682.330276:0:5814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b2adc339-cccb-4166-8f83-87a1e9e399f1->MGS 00000020:01000004:2.0:1787855682.330298:0:5814:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787855682.330304:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787855682.330316:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000faa01725) 00000020:00000080:2.0:1787855682.330328:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787855682.334752:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000862ae46c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b2adc339-cccb-4166-8f83-87a1e9e399f1:3303:1874702486208640:0@lo:250: 00000100:00100000:0.0:1787855682.334868:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855682.337093:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486208640 00000100:00100000:1.0:1787855682.337105:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486208640 00000100:00100000:1.0:1787855682.337165:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787855682.337172:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015a5f586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1874702486208640:12345-0@lo:250: 00010000:00080000:1.0:1787855682.337200:0:5826:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from b2adc339-cccb-4166-8f83-87a1e9e399f1@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:1.0:1787855682.337227:0:5826:0:(genops.c:1385:class_connect()) connect: client b2adc339-cccb-4166-8f83-87a1e9e399f1, cookie 0x516929ca3366d2e1 00000100:00080000:1.0:1787855682.337351:0:5826:0:(import.c:65:import_set_state_nolock()) 0000000078ec3d34 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787855682.337426:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015a5f586 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+5:3303:x1874702486208640:12345-0@lo:250: Request processed in 253us (2559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855682.337434:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787855682.339146:0:3303:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787855682.339164:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.138@tcp: connect to target with instance 0 00000100:00080000:0.0:1787855682.339171:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787855682.339176:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787855682.339186:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000f3cfce09 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787855682.339190:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787855682.339205:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787855682.339211:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000862ae46c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b2adc339-cccb-4166-8f83-87a1e9e399f1:3303:1874702486208640:0@lo:250: 00000100:00100000:3.0:1787855682.356668:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787855682.356898:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787855682.356904:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787855682.361661:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787855682.361678:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787855682.362174:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787855682.362181:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787855682.363182:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787855682.363398:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787855682.363412:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787855682.365070:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787855682.365083:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787855682.408109:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787855682.408383:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787855682.408389:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787855682.410029:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787855682.410039:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787855682.413115:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787855682.413403:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787855682.413410:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787855682.419682:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787855682.419699:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787855682.420859:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787855682.421037:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787855682.421043:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787855682.422938:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787855682.422951:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787855682.423536:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787855682.423715:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787855682.423720:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787855682.424659:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787855682.424668:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787855682.453093:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787855682.453326:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787855682.453332:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787855682.458701:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787855682.458721:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787855682.460631:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787855682.460643:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787855682.462261:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787855682.462500:0:5814:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787855682.462507:0:5814:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787855682.462640:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787855682.462673:0:5814:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.138@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787855682.462677:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787855682.462678:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787855682.462680:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787855682.462681:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787855682.462682:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787855682.462684:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787855682.462685:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787855682.462691:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787855682.462692:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787855682.462693:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787855682.462694:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787855682.462695:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787855682.462698:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787855682.462701:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787855682.462702:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787855682.462702:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787855682.462703:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787855682.462704:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787855682.462704:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787855682.462705:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787855682.462706:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787855682.462706:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787855682.462707:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787855682.462708:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787855682.462709:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787855682.462731:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787855682.462747:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcf994b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486208768:0@lo:253: 00000100:00100000:2.0:1787855682.462949:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855682.463089:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000001cddefb2 going to sleep for 11 seconds 00000100:00100000:1.0:1787855682.463145:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486208768 00000100:00100000:1.0:1787855682.463154:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486208768 00000100:00100000:1.0:1787855682.463242:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787855682.463251:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060170847 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+5:5814:x1874702486208768:12345-0@lo:253: 20000000:01000000:1.0:1787855682.463297:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787855682.463300:0:5828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787855682.463603:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787855682.463671:0:5828:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787855682.463992:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787855682.464739:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787855682.466772:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787855682.466938:0:5828:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787855682.466944:0:5828:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787855682.466947:0:5828:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787855682.466968:0:5828:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787855682.467224:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787855682.467488:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787855682.467501:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787855682.467546:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787855682.467604:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787855682.467658:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787855682.467746:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787855682.467755:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787855682.468031:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787855682.468040:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787855682.468071:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787855682.468078:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787855682.468107:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787855682.468150:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787855682.468182:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787855682.468187:0:5828:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787855682.468199:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787855682.468509:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787855682.468519:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787855682.468552:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787855682.468596:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787855682.468647:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787855682.468658:0:5828:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787855682.468730:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787855682.468737:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787855682.468945:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787855682.468998:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787855682.469034:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787855682.469045:0:5828:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787855682.469135:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787855682.469144:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787855682.469173:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787855682.469204:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787855682.469424:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787855682.469469:0:5828:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787855682.469476:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787855682.470071:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787855682.470390:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787855682.470410:0:5828:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.138@tcp for mdt 20000000:01000000:1.0:1787855682.470412:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:1.0:1787855682.470442:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787855682.470448:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787855682.470472:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787855682.470479:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:1.0:1787855682.470533:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787855682.470543:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787855682.470568:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787855682.470593:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787855682.470658:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787855682.470662:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787855682.470665:0:5828:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787855682.470687:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787855682.470690:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787855682.470717:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787855682.470719:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787855682.471129:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787855682.471383:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787855682.471417:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787855682.471468:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1787855682.471487:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787855682.471489:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787855682.472261:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787855682.472584:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787855682.473035:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787855682.473077:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1787855682.473091:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787855682.473093:0:5828:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787855682.473098:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787855682.473101:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787855682.473105:0:5828:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787855682.473112:0:5828:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787855682.473531:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1787855682.473641:0:5828:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1787855682.487221:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1787855682.487275:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1787855682.487346:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1787855682.487366:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787855682.487388:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000abaf239f/0x516929ca3366d2e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855682.487405:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000abaf239f/0x516929ca3366d2e8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855682.487415:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000abaf239f/0x516929ca3366d2e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855682.487421:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000abaf239f/0x516929ca3366d2e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855682.487427:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000abaf239f/0x516929ca3366d2e8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855682.487456:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000abaf239f/0x516929ca3366d2e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855682.487462:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000abaf239f already unused, calling callback (000000006e2550fb) 00010000:00010000:1.0:1787855682.487466:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000abaf239f/0x516929ca3366d2e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855682.487474:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000abaf239f/0x516929ca3366d2e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855682.487489:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000abaf239f/0x516929ca3366d2e8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855682.487497:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000abaf239f/0x516929ca3366d2e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855682.487502:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000abaf239f/0x516929ca3366d2e8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787855682.487518:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787855682.715493:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060170847 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+5:5814:x1874702486208768:12345-0@lo:253: Request processed in 252234us (252534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855682.715514:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787855682.715638:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcf994b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486208768:0@lo:253: 10000000:01000000:2.0:1787855682.715654:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787855682.715658:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787855682.715660:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787855682.715661:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787855682.715662:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787855682.715663:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787855682.715664:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787855682.715666:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787855682.715667:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787855682.715683:0:5814:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787855682.715685:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787855682.715686:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787855682.715703:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000be390fe4 from lustre-MDT0000 10000000:01000000:2.0:1787855682.715831:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787855682.715834:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787855682.715838:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a73c44919d0 10000000:01000000:2.0:1787855682.715843:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787855682.715851:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a73c44919d0 from 1 10000000:01000000:2.0:1787855682.715854:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787855682.715892:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 000000007cb3b7a3/0x516929ca3366d2ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855682.715901:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 000000007cb3b7a3/0x516929ca3366d2ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855682.715910:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 000000007cb3b7a3/0x516929ca3366d2ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855682.715926:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcf994b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486208896:0@lo:101: 00000100:00100000:2.0:1787855682.715962:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855682.716020:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000000600367b going to sleep for 11 seconds 00000100:00100000:3.0:1787855682.716149:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486208896 00000100:00100000:3.0:1787855682.716155:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486208896 00000100:00100000:3.0:1787855682.716199:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787855682.716208:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e268817 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+5:5814:x1874702486208896:12345-0@lo:101: 00010000:00010000:3.0:1787855682.716221:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855682.716235:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009194c087/0x516929ca3366d2f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d2ef expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855682.716256:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009194c087/0x516929ca3366d2f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d2ef expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855682.716265:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009194c087/0x516929ca3366d2f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d2ef expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855682.716285:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009194c087, rc 0) 00000100:00100000:3.0:1787855682.716316:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e268817 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+6:5814:x1874702486208896:12345-0@lo:101: Request processed in 109us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855682.716322:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787855682.716441:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcf994b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486208896:0@lo:101: 00010000:00010000:2.0:1787855682.716453:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 000000007cb3b7a3/0x516929ca3366d2ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d2f6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855682.716461:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 000000007cb3b7a3/0x516929ca3366d2ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d2f6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855682.716505:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcf994b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486209024:0@lo:501: 00000100:00100000:2.0:1787855682.716532:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855682.716560:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000000600367b going to sleep for 11 seconds 00000100:00100000:3.0:1787855682.716624:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486209024 00000100:00100000:3.0:1787855682.716629:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486209024 00000100:00100000:3.0:1787855682.716659:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787855682.716664:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ff7fabe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+6:5814:x1874702486209024:12345-0@lo:501: 00000100:00100000:3.0:1787855682.716979:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ff7fabe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+6:5814:x1874702486209024:12345-0@lo:501: Request processed in 314us (446us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787855682.716986:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787855682.717120:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcf994b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486209024:0@lo:501: 10000000:01000000:2.0:1787855682.717144:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787855682.717167:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 000000007cb3b7a3/0x516929ca3366d2ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d2f6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855682.717174:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 000000007cb3b7a3/0x516929ca3366d2ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d2f6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855682.717180:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a73f4b59000 10000000:01000000:2.0:1787855682.717184:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787855682.717187:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a73f4b59000 10000000:01000000:2.0:1787855682.717189:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787855682.717191:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a73f4b59000 from 1 10000000:01000000:2.0:1787855682.717193:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787855682.717208:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000373f69b4/0x516929ca3366d2fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855682.717213:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000373f69b4/0x516929ca3366d2fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855682.717220:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000373f69b4/0x516929ca3366d2fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855682.717230:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcf994b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486209152:0@lo:101: 00000100:00100000:2.0:1787855682.717255:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855682.717286:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000000600367b going to sleep for 11 seconds 00000100:00100000:1.0:1787855682.717378:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486209152 00000100:00100000:1.0:1787855682.717383:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486209152 00000100:00100000:1.0:1787855682.717416:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787855682.717423:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086f3bffa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+6:5814:x1874702486209152:12345-0@lo:101: 00010000:00010000:1.0:1787855682.717430:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855682.717440:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000abaf239f/0x516929ca3366d304 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d2fd expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855682.717456:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000abaf239f/0x516929ca3366d304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d2fd expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855682.717472:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000abaf239f/0x516929ca3366d304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d2fd expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855682.717479:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000abaf239f, rc 0) 00000100:00100000:1.0:1787855682.717510:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086f3bffa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+7:5814:x1874702486209152:12345-0@lo:101: Request processed in 88us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855682.717516:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787855682.717641:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcf994b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486209152:0@lo:101: 00010000:00010000:2.0:1787855682.717652:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000373f69b4/0x516929ca3366d2fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d304 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855682.717665:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000373f69b4/0x516929ca3366d2fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d304 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855682.717678:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787855682.717691:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000373f69b4/0x516929ca3366d2fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d304 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855682.717698:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000373f69b4/0x516929ca3366d2fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d304 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855682.717703:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787855682.717706:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787855682.717903:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a73f4b59000 10000000:01000000:2.0:1787855682.717907:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787855682.717910:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787855682.717912:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787855682.717927:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000a9a2bd60/0x516929ca3366d30b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855682.717933:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000a9a2bd60/0x516929ca3366d30b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855682.717940:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000a9a2bd60/0x516929ca3366d30b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855682.717952:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcf994b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486209280:0@lo:101: 00000100:00100000:2.0:1787855682.717978:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855682.717999:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000000600367b going to sleep for 11 seconds 00000100:00100000:2.0:1787855682.718023:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486209280 00000100:00100000:2.0:1787855682.718028:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486209280 00000100:00100000:2.0:1787855682.718060:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787855682.718066:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004989b9c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+7:5814:x1874702486209280:12345-0@lo:101: 00010000:00010000:2.0:1787855682.718073:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855682.718081:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002a9b1011/0x516929ca3366d312 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d30b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855682.718093:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a9b1011/0x516929ca3366d312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d30b expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855682.718100:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002a9b1011/0x516929ca3366d312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d30b expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855682.718106:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002a9b1011, rc 0) 00000100:00100000:2.0:1787855682.718135:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004989b9c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+8:5814:x1874702486209280:12345-0@lo:101: Request processed in 69us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855682.718141:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787855682.718173:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcf994b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486209280:0@lo:101: 00010000:00010000:2.0:1787855682.718182:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000a9a2bd60/0x516929ca3366d30b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d312 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855682.718188:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000a9a2bd60/0x516929ca3366d30b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d312 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855682.718224:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcf994b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486209408:0@lo:501: 00000100:00100000:2.0:1787855682.718249:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855682.718262:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000000600367b going to sleep for 11 seconds 00000100:00100000:2.0:1787855682.718276:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486209408 00000100:00100000:2.0:1787855682.718284:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486209408 00000100:00100000:2.0:1787855682.718308:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787855682.718313:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d56b25b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+8:5814:x1874702486209408:12345-0@lo:501: 00000100:00100000:2.0:1787855682.718503:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d56b25b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+9:5814:x1874702486209408:12345-0@lo:501: Request processed in 190us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855682.718509:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787855682.718541:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcf994b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486209408:0@lo:501: 00000100:00100000:2.0:1787855682.718565:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcf994b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486209536:0@lo:503: 00000100:00100000:2.0:1787855682.718602:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855682.718921:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486209536 00000100:00100000:1.0:1787855682.718926:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486209536 00000100:00100000:2.0:1787855682.719053:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000000600367b going to sleep for 11 seconds 00000100:00100000:1.0:1787855682.719088:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787855682.719096:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f41dbc4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+9:5814:x1874702486209536:12345-0@lo:503: 00000100:00100000:1.0:1787855682.719253:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f41dbc4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+9:5814:x1874702486209536:12345-0@lo:503: Request processed in 158us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855682.719259:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787855682.719408:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcf994b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486209536:0@lo:503: 00000100:00100000:3.0:1787855682.720028:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009636b350 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:5856:1874702486209664:0@lo:502: 00000100:00100000:3.0:1787855682.720073:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855682.720143:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 00000000988496a6 going to sleep for 11 seconds 00000100:00100000:2.0:1787855682.720181:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486209664 00000100:00100000:2.0:1787855682.720186:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486209664 00000100:00100000:2.0:1787855682.720265:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787855682.720273:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd84f8fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+9:5856:x1874702486209664:12345-0@lo:502: 00000100:00100000:2.0:1787855682.720443:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd84f8fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+9:5856:x1874702486209664:12345-0@lo:502: Request processed in 171us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855682.720450:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787855682.720520:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009636b350 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:5856:1874702486209664:0@lo:502: 00000020:01000000:3.0:1787855682.720543:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787855682.720554:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855682.720557:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787855682.720564:0:5856:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787855682.720567:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787855682.720580:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000d04fa1a) 00000020:00000080:3.0:1787855682.720597:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787855682.720603:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787855682.720686:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787855682.720693:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x516929ca3366d320 00000020:00000080:3.0:1787855682.720986:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787855682.720992:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787855682.721000:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855682.721001:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787855682.721005:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787855682.721008:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855682.721010:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787855682.721013:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787855682.721021:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000e93dcada) 00000020:00000080:3.0:1787855682.721032:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787855682.721036:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787855682.721037:0:5856:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787855682.721039:0:5856:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787855682.721045:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787855682.721090:0:5856:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000be390fe4 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787855682.721104:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000008b2a7276) 00000020:00000080:3.0:1787855682.721121:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787855682.721178:0:5856:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787855682.721184:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x516929ca3366d335 00000020:00000080:3.0:1787855682.721290:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787855682.721296:0:5856:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787855682.721302:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x516929ca3366d33c 00080000:01000000:3.0:1787855682.721307:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787855682.721310:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x516929ca3366d343 00080000:10000000:3.0:1787855682.721711:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787855682.721993:0:5856:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787855682.726462:0:5856:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787855682.780585:0:5856:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1787855682.781325:0:5856:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1787855682.784147:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787855682.784453:0:5856:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787855682.808084:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001c4dc996) 00000020:00000080:0.0:1787855682.808108:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787855682.808173:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787855682.808179:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x516929ca3366d351 00000020:00000080:0.0:1787855682.814522:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1787855682.816758:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855682.849564:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855682.876533:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855682.910215:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855682.955310:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855682.993466:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787855683.026226:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x516929ca3366d358 00000020:00000080:0.0:1787855683.026537:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787855683.026548:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787855683.026554:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855683.026556:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787855683.026559:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787855683.026563:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855683.026565:0:5856:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787855683.026567:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787855683.026569:0:5856:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787855683.026572:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787855683.026574:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855683.026575:0:5856:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787855683.026577:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787855683.026581:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855683.026589:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787855683.026594:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787855683.026637:0:5856:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1787855683.026690:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6849d8f pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:5856:1874702486209792:0@lo:502: 00000100:00100000:0.0:1787855683.026878:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855683.027000:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a3fa1048 going to sleep for 11 seconds 00000100:00100000:2.0:1787855683.027073:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486209792 00000100:00100000:2.0:1787855683.027080:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486209792 00000100:00100000:2.0:1787855683.027125:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787855683.027134:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f709ada1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+9:5856:x1874702486209792:12345-0@lo:502: 00000100:00100000:2.0:1787855683.027434:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f709ada1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+9:5856:x1874702486209792:12345-0@lo:502: Request processed in 301us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855683.027442:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787855683.027689:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6849d8f pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:5856:1874702486209792:0@lo:502: 00000020:01000000:0.0:1787855683.027731:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787855683.027737:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855683.027739:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787855683.027742:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787855683.028213:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787855683.028230:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787855683.028252:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000a9a2bd60/0x516929ca3366d30b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d312 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855683.028264:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000a9a2bd60/0x516929ca3366d30b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d312 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855683.028271:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a73f4b59000 from 1 10000000:01000000:2.0:1787855683.028274:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787855683.028302:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000db7416c9/0x516929ca3366d35f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855683.028309:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000db7416c9/0x516929ca3366d35f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855683.028316:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000db7416c9/0x516929ca3366d35f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855683.028334:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bcf994b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486209920:0@lo:101: 00000100:00100000:2.0:1787855683.028377:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855683.028490:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000002f15987c going to sleep for 11 seconds 00000100:00100000:1.0:1787855683.028581:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486209920 00000100:00100000:1.0:1787855683.028587:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486209920 00000100:00100000:1.0:1787855683.028669:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787855683.028678:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028f843ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+9:5814:x1874702486209920:12345-0@lo:101: 00010000:00010000:1.0:1787855683.028688:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855683.028711:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000974e779f/0x516929ca3366d366 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d35f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855683.028731:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000974e779f/0x516929ca3366d366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d35f expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855683.028740:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000974e779f/0x516929ca3366d366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d35f expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855683.028762:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000974e779f, rc 0) 00000100:00100000:1.0:1787855683.029007:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028f843ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+10:5814:x1874702486209920:12345-0@lo:101: Request processed in 330us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855683.029014:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787855683.029191:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bcf994b2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486209920:0@lo:101: 00010000:00010000:3.0:1787855683.029205:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000db7416c9/0x516929ca3366d35f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d366 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.029213:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000db7416c9/0x516929ca3366d35f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d366 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855683.029832:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009636b350 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486210048:0@lo:256: 00000100:00100000:3.0:1787855683.029879:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855683.030063:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000005812a147 going to sleep for 11 seconds 00000100:00100000:2.0:1787855683.030202:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486210048 00000100:00100000:2.0:1787855683.030209:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486210048 00000100:00100000:2.0:1787855683.030252:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787855683.030260:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003611063e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+10:5814:x1874702486210048:12345-0@lo:256: 20000000:01000000:2.0:1787855683.030277:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787855683.030282:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787855683.030351:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003611063e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+10:5814:x1874702486210048:12345-0@lo:256: Request processed in 92us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855683.030368:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787855683.030458:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009636b350 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486210048:0@lo:256: 10000000:01000000:3.0:1787855683.031286:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787855683.031309:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000db7416c9/0x516929ca3366d35f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d366 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.031320:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000db7416c9/0x516929ca3366d35f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d366 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855683.031327:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73f4b59000 from 1 10000000:01000000:3.0:1787855683.031330:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787855683.031359:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 000000009463c6a4/0x516929ca3366d36d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.031365:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 000000009463c6a4/0x516929ca3366d36d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.031374:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 000000009463c6a4/0x516929ca3366d36d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855683.031388:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009636b350 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486210176:0@lo:101: 00000100:00100000:3.0:1787855683.031425:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855683.031452:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000005812a147 going to sleep for 11 seconds 00000100:00100000:3.0:1787855683.031471:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486210176 00000100:00100000:3.0:1787855683.031476:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486210176 00000100:00100000:3.0:1787855683.031513:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787855683.031519:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002683d913 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+10:5814:x1874702486210176:12345-0@lo:101: 00010000:00010000:3.0:1787855683.031528:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855683.031538:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009b6520f6/0x516929ca3366d374 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d36d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.031555:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b6520f6/0x516929ca3366d374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d36d expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.031564:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009b6520f6/0x516929ca3366d374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d36d expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.031571:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009b6520f6, rc 0) 00000100:00100000:3.0:1787855683.031600:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002683d913 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:5814:x1874702486210176:12345-0@lo:101: Request processed in 82us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855683.031618:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787855683.031656:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009636b350 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486210176:0@lo:101: 00010000:00010000:3.0:1787855683.031668:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 000000009463c6a4/0x516929ca3366d36d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d374 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.031676:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 000000009463c6a4/0x516929ca3366d36d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d374 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855683.031731:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009636b350 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486210304:0@lo:501: 00000100:00100000:3.0:1787855683.031756:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855683.031770:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000005812a147 going to sleep for 11 seconds 00000100:00100000:3.0:1787855683.032054:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486210304 00000100:00100000:3.0:1787855683.032059:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486210304 00000100:00100000:3.0:1787855683.032091:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787855683.032104:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7eaf69c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:5814:x1874702486210304:12345-0@lo:501: 00000100:00100000:3.0:1787855683.032698:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7eaf69c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:5814:x1874702486210304:12345-0@lo:501: Request processed in 593us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855683.033168:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787855683.033298:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009636b350 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486210304:0@lo:501: 00000100:00100000:2.0:1787855683.033336:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c38f2f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486210432:0@lo:503: 00000100:00100000:2.0:1787855683.033381:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855683.033442:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000015658502 going to sleep for 11 seconds 00000100:00100000:3.0:1787855683.033485:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486210432 00000100:00100000:3.0:1787855683.033490:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486210432 00000100:00100000:3.0:1787855683.033559:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787855683.033568:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e54b2df4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:5814:x1874702486210432:12345-0@lo:503: 00000040:00080000:3.0:1787855683.033632:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787855683.033710:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e54b2df4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:5814:x1874702486210432:12345-0@lo:503: Request processed in 135us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855683.033717:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787855683.033796:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c38f2f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486210432:0@lo:503: 00000040:00080000:0.0:1787855683.035117:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787855683.035307:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787855683.035326:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787855683.035346:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 000000009463c6a4/0x516929ca3366d36d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d374 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855683.035358:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 000000009463c6a4/0x516929ca3366d36d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d374 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855683.035406:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787855683.035409:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a73f4b59000 10000000:01000000:2.0:1787855683.035412:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a73f4b59000 10000000:01000000:2.0:1787855683.035415:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787855683.035421:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a73f4b59000 from 1 10000000:01000000:2.0:1787855683.035423:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787855683.035453:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000c256be7d/0x516929ca3366d37b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855683.035461:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000c256be7d/0x516929ca3366d37b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855683.035468:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000c256be7d/0x516929ca3366d37b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855683.035500:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c38f2f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486210560:0@lo:101: 00000100:00100000:2.0:1787855683.035553:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855683.035761:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084cc61fd going to sleep for 11 seconds 00000100:00100000:1.0:1787855683.036114:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486210560 00000100:00100000:1.0:1787855683.036121:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486210560 00000100:00100000:1.0:1787855683.036156:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787855683.036165:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf3342a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:5814:x1874702486210560:12345-0@lo:101: 00010000:00010000:1.0:1787855683.036178:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855683.036191:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000095dbc47e/0x516929ca3366d382 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d37b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855683.036213:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000095dbc47e/0x516929ca3366d382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d37b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855683.036222:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000095dbc47e/0x516929ca3366d382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d37b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855683.036230:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000095dbc47e, rc 0) 00000100:00100000:1.0:1787855683.036279:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf3342a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5814:x1874702486210560:12345-0@lo:101: Request processed in 115us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855683.036285:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787855683.036464:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c38f2f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486210560:0@lo:101: 00010000:00010000:2.0:1787855683.036478:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000c256be7d/0x516929ca3366d37b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d382 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855683.036485:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000c256be7d/0x516929ca3366d37b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d382 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855683.036532:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c38f2f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486210688:0@lo:501: 00000100:00100000:2.0:1787855683.036557:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855683.036584:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084cc61fd going to sleep for 11 seconds 00000100:00100000:0.0:1787855683.036637:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486210688 00000100:00100000:0.0:1787855683.036642:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486210688 00000100:00100000:0.0:1787855683.036673:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787855683.036679:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5b6b918 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5814:x1874702486210688:12345-0@lo:501: 00000100:00100000:0.0:1787855683.037149:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5b6b918 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5814:x1874702486210688:12345-0@lo:501: Request processed in 469us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855683.037156:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787855683.037230:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c38f2f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486210688:0@lo:501: 00000100:00100000:2.0:1787855683.037258:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003c38f2f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486210816:0@lo:503: 00000100:00100000:2.0:1787855683.037295:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855683.037324:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084cc61fd going to sleep for 11 seconds 00000100:00100000:0.0:1787855683.037372:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486210816 00000100:00100000:0.0:1787855683.037378:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486210816 00000100:00100000:0.0:1787855683.037411:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787855683.037418:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2e513d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5814:x1874702486210816:12345-0@lo:503: 00000100:00100000:0.0:1787855683.037729:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2e513d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5814:x1874702486210816:12345-0@lo:503: Request processed in 311us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855683.037735:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787855683.037773:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003c38f2f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486210816:0@lo:503: 00000100:00100000:0.0:1787855683.038161:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6849d8f pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:5861:1874702486210944:0@lo:502: 00000100:00100000:0.0:1787855683.038198:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855683.038219:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486210944 00000100:00100000:0.0:1787855683.038224:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486210944 00000100:00100000:0.0:1787855683.038241:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787855683.038247:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff359617 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5861:x1874702486210944:12345-0@lo:502: 00000100:00100000:0.0:1787855683.038415:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff359617 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5861:x1874702486210944:12345-0@lo:502: Request processed in 168us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855683.038421:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787855683.038448:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e11fbf72 going to sleep for 11 seconds 00000100:00100000:0.0:1787855683.038461:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6849d8f pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:5861:1874702486210944:0@lo:502: 00000020:01000004:0.0:1787855683.038513:0:5861:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787855683.038528:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000bd466a66) 00000020:00000080:0.0:1787855683.038546:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787855683.038639:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000be390fe4 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787855683.038644:0:5861:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000be390fe4 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787855683.038647:0:5861:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000be390fe4 4 00010000:00080000:0.0:1787855683.038674:0:5861:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000009ec179c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:0.0:1787855683.043450:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787855683.044005:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787855683.044047:0:5861:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787855683.044059:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x516929ca3366d390 00000100:00080000:0.0:1787855683.044070:0:5861:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787855683.044076:0:5861:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000009ec179c using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1787855683.044112:0:5861:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a6849d8f x1874702486211072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787855683.044137:0:5861:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787855683.044560:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6849d8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874702486211072:0@lo:38: 00000100:00100000:1.0:1787855683.044648:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855683.044826:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486211072 00000100:00100000:2.0:1787855683.044835:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486211072 00000100:00100000:2.0:1787855683.044871:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787855683.044877:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031867c33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874702486211072:12345-0@lo:38: 00000100:00100000:2.0:1787855683.045018:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031867c33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874702486211072:12345-0@lo:38: Request processed in 140us (370us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787855683.045026:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787855683.045223:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004a77c964 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:5861:1874702486211200:0@lo:502: 00000100:00100000:0.0:1787855683.045273:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855683.045297:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486211200 00000100:00100000:0.0:1787855683.045301:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486211200 00000100:00100000:0.0:1787855683.045335:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787855683.045341:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012ddbf44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5861:x1874702486211200:12345-0@lo:502: 00000100:00100000:0.0:1787855683.045529:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012ddbf44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5861:x1874702486211200:12345-0@lo:502: Request processed in 187us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855683.045536:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787855683.045579:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 00000000028f5bee going to sleep for 11 seconds 00000100:00100000:0.0:1787855683.045600:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004a77c964 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:5861:1874702486211200:0@lo:502: 00000040:00080000:0.0:1787855683.045633:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787855683.045682:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787855683.045764:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787855683.045795:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 00000000c256be7d/0x516929ca3366d37b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d382 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855683.045877:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 00000000c256be7d/0x516929ca3366d37b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d382 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787855683.045994:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787855683.045996:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787855683.045998:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787855683.045999:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787855683.046000:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787855683.046001:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787855683.046002:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787855683.046004:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787855683.046005:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787855683.046007:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787855683.046008:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787855683.046013:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787855683.046017:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787855683.046019:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787855683.046020:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787855683.046021:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787855683.046022:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787855683.046023:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787855683.046024:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787855683.046025:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787855683.046025:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787855683.046026:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787855683.046027:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787855683.046028:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787855683.046029:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787855683.046041:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787855683.046049:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004a77c964 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486211328:0@lo:253: 00000100:00100000:0.0:1787855683.046083:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855683.046098:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e11fbf72 going to sleep for 11 seconds 00000100:00100000:1.0:1787855683.046342:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787855683.046349:0:3303:0:(import.c:65:import_set_state_nolock()) 0000000009ec179c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787855683.046354:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787855683.046362:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6849d8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874702486211072:0@lo:38: 00000100:00100000:2.0:1787855683.046424:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486211328 00000100:00100000:2.0:1787855683.046435:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486211328 00000100:00100000:2.0:1787855683.046473:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787855683.046479:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e916e343 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5814:x1874702486211328:12345-0@lo:253: 20000000:01000000:2.0:1787855683.046501:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787855683.046515:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787855683.091983:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787855683.092007:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787855683.092056:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787855683.092061:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787855683.092085:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000009212d3c/0x516929ca3366d397 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855683.092104:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000974e779f/0x516929ca3366d366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d35f expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855683.092112:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000009212d3c/0x516929ca3366d397 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855683.092147:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000974e779f/0x516929ca3366d366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d35f expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855683.092160:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000974e779f/0x516929ca3366d366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d35f expref: 12 pid: 5827 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855683.092193:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2f0c670 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874702486211456:0@lo:104: 00000100:00100000:0.0:1787855683.092270:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855683.092331:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 00000000710b60ca going to sleep for 11 seconds 00000100:00100000:3.0:1787855683.093444:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486211456 00000100:00100000:3.0:1787855683.093453:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486211456 00000100:00100000:3.0:1787855683.093500:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787855683.093507:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6d635ae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:5849:x1874702486211456:12345-0@lo:104: 00010000:00010000:3.0:1787855683.093532:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: 00000000db7416c9/0x516929ca3366d35f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d366 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.093626:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787855683.093631:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6d635ae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:5849:x1874702486211456:12345-0@lo:104: Request processed in 125us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855683.093638:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787855683.093665:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787855683.093670:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: 00000000db7416c9/0x516929ca3366d35f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d366 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.093692:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000db7416c9 already unused, calling callback (0000000058b847dd) 10000000:00010000:3.0:1787855683.093695:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: 00000000db7416c9/0x516929ca3366d35f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d366 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.093707:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: 00000000db7416c9/0x516929ca3366d35f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d366 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787855683.093714:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: 00000000db7416c9/0x516929ca3366d35f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d366 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855683.093720:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787855683.093752:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: 00000000db7416c9/0x516929ca3366d35f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d366 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.093759:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787855683.093992:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: 00000000db7416c9/0x516929ca3366d35f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d366 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.094000:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: 00000000db7416c9/0x516929ca3366d35f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d366 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.094017:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855683.094018:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855683.094020:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855683.094104:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006e7175f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486211584:0@lo:103: 00000100:00100000:3.0:1787855683.094143:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855683.094220:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486211584 00000100:00100000:3.0:1787855683.094225:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486211584 00010000:00010000:3.0:1787855683.094243:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000974e779f/0x516929ca3366d366 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d35f expref: 13 pid: 5827 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855683.094274:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787855683.094281:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c15ddc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:3305:x1874702486211584:12345-0@lo:103: 00010000:00010000:3.0:1787855683.094302:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855683.094307:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000974e779f/0x516929ca3366d366 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d35f expref: 13 pid: 5827 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.094318:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000974e779f/0x516929ca3366d366 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d35f expref: 13 pid: 5827 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.094333:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000009212d3c/0x516929ca3366d397 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.094341:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000009212d3c/0x516929ca3366d397 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787855683.094356:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002294828s 00010000:00010000:3.0:1787855683.094359:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000009212d3c/0x516929ca3366d397 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.094366:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000009212d3c/0x516929ca3366d397 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.094371:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000009212d3c/0x516929ca3366d397 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.094377:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000009212d3c/0x516929ca3366d397 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.094382:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000009212d3c already unused, calling callback (000000006e2550fb) 00010000:00010000:3.0:1787855683.094385:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000009212d3c/0x516929ca3366d397 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.094397:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000009212d3c/0x516929ca3366d397 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.094405:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000009212d3c/0x516929ca3366d397 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855683.094414:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855683.094441:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c15ddc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:3305:x1874702486211584:12345-0@lo:103: Request processed in 161us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855683.094448:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787855683.094477:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006e7175f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486211584:0@lo:103: 00010000:00010000:0.0:1787855683.094906:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000974e779f/0x516929ca3366d366 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d35f expref: 12 pid: 5827 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855683.094919:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2f0c670 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874702486211456:0@lo:104: 00010000:00010000:0.0:1787855683.094933:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000009212d3c/0x516929ca3366d397 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855683.094942:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000009212d3c/0x516929ca3366d397 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855683.094949:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000009212d3c/0x516929ca3366d397 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855683.094956:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000009212d3c/0x516929ca3366d397 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855683.105491:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e916e343 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:5814:x1874702486211328:12345-0@lo:253: Request processed in 59002us (59398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855683.105508:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787855683.105919:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004a77c964 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:5814:1874702486211328:0@lo:253: 10000000:01000000:0.0:1787855683.105937:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787855683.105941:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787855683.105943:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787855683.105944:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787855683.105946:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787855683.105947:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787855683.105948:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787855683.105949:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787855683.105950:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787855683.105952:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787855683.105968:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787855683.105970:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787855683.105972:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787855683.105987:0:5814:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787855683.112321:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855683.113135:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787855683.113386:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855683.114295:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787855683.114685:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855683.115050:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787855683.116392:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855683.116934:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787855683.117176:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855683.117371:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787855683.118018:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855683.118244:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1787855683.166671:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787855683.202265:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787855683.202341:0:5866:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787855683.202346:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787855683.203996:0:5867:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787855683.207103:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787855683.207301:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787855683.207732:0:5814:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787855683.207740:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787855683.207908:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787855683.209492:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787855683.210222:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787855683.210256:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787855683.210523:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787855683.210735:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1787855683.213130:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787855683.213279:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787855683.213433:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787855683.213596:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787855683.214194:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787855683.214339:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1787855683.214507:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1787855683.214677:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1787855683.215028:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1787855683.215191:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1787855683.215358:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1787855683.215544:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1787855683.215723:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787855683.216340:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787855683.216498:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787855683.216669:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787855683.217453:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787855683.217632:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787855683.218060:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787855683.218200:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787855683.218359:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787855683.218493:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787855683.218677:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787855683.219361:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787855683.219562:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787855683.220226:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787855683.220412:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787855683.220565:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787855683.221271:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787855683.221420:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787855683.221571:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787855683.221864:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787855683.222089:0:5814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787855683.255679:0:5867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787855683.304369:0:5814:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787855683.304408:0:5814:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb34381d1b988 00100000:10000000:2.0:1787855683.304427:0:5814:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787855683.306317:0:5814:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787855683.306335:0:5814:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787855683.306347:0:5814:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787855683.306395:0:5814:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787855683.323917:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787855683.348610:0:5867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787855683.348692:0:5867:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787855683.348697:0:5867:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787855684.349025:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855685.371991:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855686.395939:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855687.431206:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787855687.940258:0:6110:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1787855688.318392:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787855688.318400:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a73f4b59000 from 3 10000000:01000000:2.0:1787855688.318405:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787855688.318464:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 0000000025bed6de/0x516929ca3366d39e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855688.318477:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 0000000025bed6de/0x516929ca3366d39e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855688.318488:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 0000000025bed6de/0x516929ca3366d39e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855688.318512:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c62e79bf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486211712:0@lo:101: 00000100:00100000:2.0:1787855688.318589:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855688.318651:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c23dc2d9 going to sleep for 11 seconds 00000100:00100000:0.0:1787855688.318809:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486211712 00000100:00100000:0.0:1787855688.318817:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486211712 00000100:00100000:0.0:1787855688.318874:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787855688.318884:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b40e15b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:5830:x1874702486211712:12345-0@lo:101: 00010000:00010000:0.0:1787855688.318897:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855688.318909:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fb542ae/0x516929ca3366d3a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d39e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855688.318931:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fb542ae/0x516929ca3366d3a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d39e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855688.318956:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fb542ae/0x516929ca3366d3a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d39e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855688.318970:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fb542ae, rc 0) 00000100:00100000:0.0:1787855688.319019:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b40e15b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5830:x1874702486211712:12345-0@lo:101: Request processed in 137us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855688.319026:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787855688.319139:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c62e79bf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486211712:0@lo:101: 00010000:00010000:3.0:1787855688.319153:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 0000000025bed6de/0x516929ca3366d39e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d3a5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855688.319160:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 0000000025bed6de/0x516929ca3366d39e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d3a5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855688.319208:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006e7175f4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486211840:0@lo:256: 00000100:00100000:3.0:1787855688.319238:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855688.319267:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a9b5e54a going to sleep for 11 seconds 00000100:00100000:2.0:1787855688.319322:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486211840 00000100:00100000:2.0:1787855688.319326:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486211840 00000100:00100000:2.0:1787855688.319356:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787855688.319363:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007db25640 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5830:x1874702486211840:12345-0@lo:256: 20000000:01000000:2.0:1787855688.319377:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787855688.319393:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787855688.319396:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787855688.319670:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007db25640 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5830:x1874702486211840:12345-0@lo:256: Request processed in 307us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855688.319678:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787855688.321702:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787855688.321713:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787855688.321715:0:8:0:(import.c:65:import_set_state_nolock()) 0000000009ec179c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787855688.321727:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000009ec179c using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1787855688.321762:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000080081fbe x1874702486211968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787855688.321995:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000080081fbe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874702486211968:0@lo:38: 00000100:00100000:2.0:1787855688.322077:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855688.322441:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486211968 00000100:00100000:1.0:1787855688.322460:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486211968 00000100:00100000:1.0:1787855688.322498:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787855688.322505:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000484744c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874702486211968:12345-0@lo:38: 00010000:00080000:1.0:1787855688.322537:0:5835:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:1.0:1787855688.322572:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x516929ca3366d3ac 00000004:00100000:1.0:1787855688.322622:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787855688.322726:0:5835:0:(import.c:65:import_set_state_nolock()) 00000000a6b01032 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787855688.322822:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000484744c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874702486211968:12345-0@lo:38: Request processed in 316us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855688.322829:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787855688.322989:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000080081fbe x1874702486211968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787855698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787855688.323005:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787855688.323012:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787855688.323017:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787855688.323019:0:3303:0:(import.c:65:import_set_state_nolock()) 0000000009ec179c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787855688.323024:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000080081fbe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874702486211968:0@lo:38: 00000100:00100000:3.0:1787855688.324759:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006e7175f4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486211840:0@lo:256: 10000000:01000000:2.0:1787855688.324977:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787855688.324988:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: 0000000025bed6de/0x516929ca3366d39e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d3a5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855688.324999:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: 0000000025bed6de/0x516929ca3366d39e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d3a5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855688.444904:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855689.469558:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855690.494638:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855691.516881:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787855692.468106:0:6312:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd13e5a10 20000000:00000080:1.0:1787855692.468123:0:6312:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a73f9d3d800 uarg=0000000000000000 20000000:01000000:1.0:1787855692.468157:0:6312:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787855692.468165:0:6312:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787855692.468178:0:6312:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787855692.468471:0:6312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787855692.468482:0:6312:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787855692.482854:0:6312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787855692.483109:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787855692.483166:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787855692.483217:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787855692.483238:0:6312:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787855692.483258:0:6312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009fa98462/0x516929ca3366d3b3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855692.483278:0:6312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009b6520f6/0x516929ca3366d374 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d36d expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855692.483285:0:6312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009fa98462/0x516929ca3366d3b3 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855692.483326:0:6312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009b6520f6/0x516929ca3366d374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d36d expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855692.483341:0:6312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009b6520f6/0x516929ca3366d374 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d36d expref: 11 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855692.483354:0:6312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037d063a3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6312:1874702486212096:0@lo:104: 00000100:00100000:2.0:1787855692.483418:0:6312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855692.483498:0:6312:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f9f696b going to sleep for 11 seconds 00000100:00100000:0.0:1787855692.483632:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486212096 00000100:00100000:0.0:1787855692.483640:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486212096 00000100:00100000:0.0:1787855692.483693:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787855692.483702:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c72f119d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:6312:x1874702486212096:12345-0@lo:104: 00010000:00010000:0.0:1787855692.483713:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: 000000009463c6a4/0x516929ca3366d36d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d374 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.483769:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787855692.483796:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c72f119d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:6312:x1874702486212096:12345-0@lo:104: Request processed in 96us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855692.483804:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787855692.483826:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855692.483837:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: 000000009463c6a4/0x516929ca3366d36d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d374 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.483844:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009463c6a4 already unused, calling callback (0000000058b847dd) 10000000:00010000:0.0:1787855692.483847:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: 000000009463c6a4/0x516929ca3366d36d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d374 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.483856:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: 000000009463c6a4/0x516929ca3366d36d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d374 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855692.483861:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: 000000009463c6a4/0x516929ca3366d36d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d374 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855692.483866:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787855692.483895:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: 000000009463c6a4/0x516929ca3366d36d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d374 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.483901:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787855692.483917:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: 000000009463c6a4/0x516929ca3366d36d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d374 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.483922:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: 000000009463c6a4/0x516929ca3366d36d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d374 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.483939:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855692.483940:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855692.483942:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855692.484233:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2f0c670 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486212224:0@lo:103: 00000100:00100000:2.0:1787855692.484278:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855692.484338:0:6312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037d063a3 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6312:1874702486212096:0@lo:104: 00010000:00010000:2.0:1787855692.484356:0:6312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009fa98462/0x516929ca3366d3b3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855692.485288:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486212224 00000100:00100000:0.0:1787855692.485298:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486212224 00010000:00010000:0.0:1787855692.485329:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009b6520f6/0x516929ca3366d374 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d36d expref: 12 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855692.485381:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787855692.485390:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090ea2942 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:3306:x1874702486212224:12345-0@lo:103: 00010000:00010000:0.0:1787855692.485404:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855692.485409:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009b6520f6/0x516929ca3366d374 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d36d expref: 12 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.485419:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009b6520f6/0x516929ca3366d374 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d36d expref: 12 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.485433:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009b6520f6/0x516929ca3366d374 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d36d expref: 12 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.485459:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009fa98462/0x516929ca3366d3b3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.485467:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fa98462/0x516929ca3366d3b3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.485482:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009fa98462/0x516929ca3366d3b3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.485489:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009fa98462/0x516929ca3366d3b3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.485495:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009fa98462/0x516929ca3366d3b3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.485501:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009fa98462/0x516929ca3366d3b3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.485517:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009fa98462 already unused, calling callback (000000006e2550fb) 00010000:00010000:0.0:1787855692.485520:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009fa98462/0x516929ca3366d3b3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.485528:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009fa98462/0x516929ca3366d3b3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.485538:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009fa98462/0x516929ca3366d3b3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855692.485548:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855692.485610:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090ea2942 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:3306:x1874702486212224:12345-0@lo:103: Request processed in 221us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855692.485629:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787855692.485666:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2f0c670 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486212224:0@lo:103: 00010000:00010000:2.0:1787855692.487311:0:6312:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009fa98462/0x516929ca3366d3b3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855692.487329:0:6312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009fa98462/0x516929ca3366d3b3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855692.487336:0:6312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009fa98462/0x516929ca3366d3b3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855692.542603:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855693.437955:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020bfd7ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486212480:0@lo:400: 00000100:00100000:1.0:1787855693.437955:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073ad92d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486212352:0@lo:400: 00000100:00100000:2.0:1787855693.440717:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855693.440717:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855693.440804:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486212352 00000100:00100000:3.0:1787855693.440814:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486212352 00000100:00100000:3.0:1787855693.440872:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787855693.440881:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ef05dd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:3307:x1874702486212352:12345-0@lo:400: 00000100:00100000:0.0:1787855693.440892:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486212480 00000100:00100000:0.0:1787855693.440895:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486212480 00000100:00100000:0.0:1787855693.440925:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787855693.440930:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c62e79bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486212480:12345-0@lo:400: 00000100:00100000:3.0:1787855693.440934:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ef05dd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:3307:x1874702486212352:12345-0@lo:400: Request processed in 56us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855693.440941:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787855693.440978:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c62e79bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486212480:12345-0@lo:400: Request processed in 47us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855693.440984:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787855693.441241:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000020bfd7ef x1874702486212480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855693.441241:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073ad92d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486212352:0@lo:400: 00000100:00100000:2.0:1787855693.441253:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020bfd7ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486212480:0@lo:400: 00010000:00010000:0.0:1787855693.563962:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855694.588013:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855695.611904:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855696.635986:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787855697.532046:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787855697.532055:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73f4b59000 from 1 10000000:01000000:0.0:1787855697.532059:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787855697.532111:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: 00000000d0cd3cf5/0x516929ca3366d3ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855697.532149:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: 00000000d0cd3cf5/0x516929ca3366d3ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855697.532161:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: 00000000d0cd3cf5/0x516929ca3366d3ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855697.532187:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004a77c964 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486212608:0@lo:101: 00000100:00100000:0.0:1787855697.532259:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855697.532641:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486212608 00000100:00100000:2.0:1787855697.532650:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486212608 00000100:00100000:2.0:1787855697.532720:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787855697.532729:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000843e7681 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:5830:x1874702486212608:12345-0@lo:101: 00010000:00010000:2.0:1787855697.532754:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855697.532768:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fa98462/0x516929ca3366d3c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d3ba expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855697.532819:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fa98462/0x516929ca3366d3c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d3ba expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855697.532829:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fa98462/0x516929ca3366d3c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d3ba expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855697.532838:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fa98462, rc 0) 00000100:00100000:2.0:1787855697.532877:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000843e7681 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5830:x1874702486212608:12345-0@lo:101: Request processed in 150us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855697.532884:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787855697.533913:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e007d75f going to sleep for 11 seconds 00000100:00100000:0.0:1787855697.533947:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004a77c964 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486212608:0@lo:101: 00010000:00010000:0.0:1787855697.533980:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: 00000000d0cd3cf5/0x516929ca3366d3ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d3c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855697.533991:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: 00000000d0cd3cf5/0x516929ca3366d3ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d3c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855697.534063:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004a77c964 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486212736:0@lo:501: 00000100:00100000:0.0:1787855697.534111:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855697.534203:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486212736 00000100:00100000:2.0:1787855697.534210:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486212736 00000100:00100000:2.0:1787855697.534246:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787855697.534255:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045307ef8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5830:x1874702486212736:12345-0@lo:501: 00000100:00100000:2.0:1787855697.534585:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045307ef8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5830:x1874702486212736:12345-0@lo:501: Request processed in 331us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855697.534593:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787855697.536104:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e007d75f going to sleep for 11 seconds 00000100:00100000:0.0:1787855697.536153:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004a77c964 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486212736:0@lo:501: 00000100:00100000:0.0:1787855697.536203:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004a77c964 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486212864:0@lo:503: 00000100:00100000:0.0:1787855697.536270:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855697.536433:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e007d75f going to sleep for 11 seconds 00000100:00100000:3.0:1787855697.536599:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486212864 00000100:00100000:3.0:1787855697.536607:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486212864 00000100:00100000:3.0:1787855697.536659:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787855697.536667:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000741465a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5830:x1874702486212864:12345-0@lo:503: 00000100:00100000:3.0:1787855697.536887:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000741465a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5830:x1874702486212864:12345-0@lo:503: Request processed in 221us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855697.536895:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787855697.537176:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004a77c964 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486212864:0@lo:503: 00000100:00100000:0.0:1787855697.537871:0:6643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004a77c964 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:6643:1874702486212992:0@lo:502: 00000100:00100000:0.0:1787855697.537927:0:6643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855697.538081:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486212992 00000100:00100000:3.0:1787855697.538088:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486212992 00000100:00100000:3.0:1787855697.538127:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787855697.538135:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ccf8331 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6643:x1874702486212992:12345-0@lo:502: 00000100:00100000:3.0:1787855697.538399:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ccf8331 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6643:x1874702486212992:12345-0@lo:502: Request processed in 264us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855697.538406:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787855697.538892:0:6643:0:(client.c:2715:ptlrpc_set_wait()) set 0000000000bd3004 going to sleep for 11 seconds 00000100:00100000:0.0:1787855697.538914:0:6643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004a77c964 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:6643:1874702486212992:0@lo:502: 00000020:01000000:0.0:1787855697.538939:0:6643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787855697.538948:0:6643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855697.538950:0:6643:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787855697.538968:0:6643:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a73f4b59000 00000020:00000080:0.0:1787855697.538971:0:6643:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787855697.539012:0:6643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb675a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:6643:1874702486213120:0@lo:502: 00000100:00100000:0.0:1787855697.539051:0:6643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855697.539067:0:6643:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855697.541181:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486213120 00000100:00100000:1.0:1787855697.541194:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486213120 00000100:00100000:1.0:1787855697.541254:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787855697.541263:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6643:x1874702486213120:12345-0@lo:502: 00000100:00100000:1.0:1787855697.541718:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6643:x1874702486213120:12345-0@lo:502: Request processed in 455us (2665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855697.541726:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787855697.542101:0:6643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb675a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:6643:1874702486213120:0@lo:502: 00000020:01000000:0.0:1787855697.542135:0:6643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787855697.542144:0:6643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855697.542147:0:6643:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787855697.542151:0:6643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787855697.542949:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787855697.542983:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787855697.542993:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c0031200/0x516929ca3366d3ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d3c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855697.543004:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c0031200/0x516929ca3366d3ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d3c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855697.665735:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787855698.375484:0:6676:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787855698.375624:0:6676:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787855698.375767:0:6676:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a73d0d01000 00000020:01000004:3.0:1787855698.375829:0:6676:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787855698.375847:0:6676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787855698.375869:0:6676:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a73d06e33a0) 00000020:00000080:3.0:1787855698.375889:0:6676:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787855698.396101:0:6676:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787855698.396936:0:6676:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787855698.435058:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787855698.451269:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787855698.451304:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787855698.452087:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787855698.452128:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787855698.453093:0:6676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787855698.453107:0:6676:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787855698.453119:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x516929ca3366d3cf 00000020:01000004:2.0:1787855698.453127:0:6676:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787855698.453149:0:6676:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.138@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787855698.453152:0:6676:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787855698.453158:0:6676:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787855698.453163:0:6676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787855698.453176:0:6676:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a73c4494d70) 00000020:00000080:2.0:1787855698.453187:0:6676:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1787855698.463062:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787855698.463265:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787855698.463271:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787855698.473139:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787855698.473152:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787855698.479956:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787855698.479972:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787855698.482067:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787855698.482271:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787855698.482277:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787855698.483656:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787855698.483668:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787855698.529595:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787855698.530001:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787855698.530007:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787855698.539095:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787855698.539202:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787855698.543327:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787855698.543353:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787855698.548215:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787855698.549901:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787855698.549910:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787855698.550966:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787855698.550976:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787855698.556103:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486213248:0@lo:400: 00000100:00100000:2.0:1787855698.556190:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855698.556267:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486213376:0@lo:400: 00000100:00100000:2.0:1787855698.556297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855698.556361:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486213248 00000100:00100000:2.0:1787855698.556369:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486213248 00000100:00100000:2.0:1787855698.556427:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787855698.556446:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:3305:x1874702486213248:12345-0@lo:400: 00000100:00100000:2.0:1787855698.556508:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:3305:x1874702486213248:12345-0@lo:400: Request processed in 72us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855698.556515:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787855698.556564:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486213376 00000100:00100000:2.0:1787855698.556568:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486213376 00000100:00100000:2.0:1787855698.556597:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787855698.556604:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486213376:12345-0@lo:400: 00000100:00100000:2.0:1787855698.556654:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486213376:12345-0@lo:400: Request processed in 51us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855698.556660:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787855698.556701:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a73cb6f6d00 x1874702486213376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855698.556715:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486213376:0@lo:400: 00000100:00100000:2.0:1787855698.556744:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486213248:0@lo:400: 00000100:00100000:2.0:1787855698.612650:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787855698.612898:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787855698.612904:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787855698.614436:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787855698.614449:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787855698.615018:0:6676:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787855698.615042:0:6676:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787855698.615048:0:6676:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787855698.644270:0:6676:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787855698.644378:0:6676:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.138@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787855698.644383:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787855698.644385:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787855698.644387:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787855698.644388:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787855698.644389:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787855698.644390:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787855698.644392:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787855698.644393:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787855698.644394:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787855698.644396:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787855698.644397:0:6676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787855698.644400:0:6676:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787855698.644403:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787855698.644404:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787855698.644405:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787855698.644406:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787855698.644407:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787855698.644409:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787855698.644409:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787855698.644410:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787855698.644411:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787855698.644412:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787855698.644413:0:6676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787855698.644450:0:6676:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787855698.644471:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486213504:0@lo:253: 00000100:00100000:3.0:1787855698.644603:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855698.644711:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c96daa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787855698.644759:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486213504 00000100:00100000:2.0:1787855698.644766:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486213504 00000100:00100000:2.0:1787855698.645045:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787855698.645056:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6676:x1874702486213504:12345-0@lo:253: 20000000:01000000:2.0:1787855698.645086:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787855698.645090:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787855698.645095:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787855698.645098:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787855698.646674:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787855698.648401:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787855698.648425:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787855698.648485:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787855698.648495:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787855698.648527:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787855698.648658:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787855698.652259:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787855698.652289:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.138@tcp 20000000:01000000:0.0:1787855698.652291:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:0.0:1787855698.652409:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787855698.652432:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787855698.652489:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787855698.652498:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:0.0:1787855698.652531:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787855698.652611:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787855698.652649:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787855698.652702:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787855698.654923:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787855698.654956:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.138@tcp 20000000:01000000:1.0:1787855698.654959:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:1.0:1787855698.655002:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787855698.655012:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787855698.655040:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787855698.655048:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:1.0:1787855698.655092:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787855698.655103:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787855698.655136:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787855698.655169:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787855698.655186:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787855698.655189:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787855698.655193:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787855698.655207:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787855698.655210:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787855698.655241:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787855698.655243:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787855698.655930:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1787855698.655984:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1787855698.656039:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787855698.656411:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787855698.656455:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787855698.656514:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787855698.656529:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787855698.656531:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787855698.658009:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787855698.658462:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787855698.658510:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787855698.658581:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787855698.658595:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787855698.658598:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787855698.660097:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787855698.660187:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787855698.660236:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787855698.660632:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787855698.660696:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787855698.660732:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787855698.660749:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787855698.660751:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787855698.660759:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787855698.660898:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a73c166d600/0x516929ca3366d3dd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855698.660917:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a7402173800/0x516929ca3366d2f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d2ef expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855698.660926:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a7402047800/0x516929ca3366d312 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d30b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855698.660933:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c166dc00/0x516929ca3366d382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d37b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855698.660940:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a73c166d600/0x516929ca3366d3dd lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855698.660980:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c166dc00/0x516929ca3366d382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d37b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855698.660993:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a73c166dc00/0x516929ca3366d382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d37b expref: 12 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855698.661008:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc256580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1874702486213632:0@lo:104: 00000100:00100000:1.0:1787855698.661078:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787855698.661709:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a7402047800/0x516929ca3366d312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d30b expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855698.661720:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a7402047800/0x516929ca3366d312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d30b expref: 12 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855698.661740:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1874702486213760:0@lo:104: 00000100:00100000:1.0:1787855698.661771:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787855698.664351:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a7402173800/0x516929ca3366d2f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d2ef expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855698.664372:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a7402173800/0x516929ca3366d2f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d2ef expref: 12 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855698.664386:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc255680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1874702486213888:0@lo:104: 00000100:00100000:1.0:1787855698.664442:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855698.664541:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486213632 00000100:00100000:2.0:1787855698.664549:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486213632 00000100:00100000:2.0:1787855698.664592:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486213760 00000100:00100000:2.0:1787855698.664596:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486213760 00000100:00100000:2.0:1787855698.664611:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787855698.664619:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc254b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+4:5826:x1874702486213632:12345-0@lo:104: 00000100:00100000:1.0:1787855698.665455:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73f4a6b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855698.665548:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486213888 00000100:00100000:0.0:1787855698.665554:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486213888 00010000:00010000:2.0:1787855698.665702:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a7402047e00/0x516929ca3366d37b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d382 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.665936:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787855698.665944:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc254b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+5:5826:x1874702486213632:12345-0@lo:104: Request processed in 1324us (4864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855698.665952:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787855698.665974:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787855698.665982:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc257840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+4:5826:x1874702486213760:12345-0@lo:104: 00010000:00010000:2.0:1787855698.665989:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d30b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d312 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.666025:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787855698.666030:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc257840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+4:5826:x1874702486213760:12345-0@lo:104: Request processed in 50us (4259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855698.666036:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787855698.666047:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787855698.666053:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc2570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:5826:x1874702486213888:12345-0@lo:104: 00010000:00010000:2.0:1787855698.666060:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d2ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d2f6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.666085:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787855698.666090:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc2570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:5826:x1874702486213888:12345-0@lo:104: Request processed in 37us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855698.666094:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787855698.666114:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787855698.666120:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402047e00/0x516929ca3366d37b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d382 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.666132:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402047e00 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:2.0:1787855698.666137:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402047e00/0x516929ca3366d37b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d382 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.666145:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402047e00/0x516929ca3366d37b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d382 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787855698.666152:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402047e00/0x516929ca3366d37b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d382 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855698.666157:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787855698.666192:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402047e00/0x516929ca3366d37b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d382 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.666199:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787855698.666215:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402047e00/0x516929ca3366d37b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d382 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.666222:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402047e00/0x516929ca3366d37b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d382 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.666232:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787855698.666235:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d30b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d312 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.666239:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402047600 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:2.0:1787855698.666241:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d30b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d312 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.666256:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d30b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d312 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787855698.666262:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d30b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d312 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855698.666266:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787855698.666278:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d30b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d312 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.666283:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787855698.666295:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d30b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d312 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.666301:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d30b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d312 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.666409:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855698.666415:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d2ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d2f6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.666422:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402046000 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787855698.666425:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d2ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d2f6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.666432:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d2ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d2f6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855698.666439:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d2ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d2f6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855698.666444:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787855698.666461:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d2ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d2f6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.666467:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787855698.666472:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d2ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d2f6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.666489:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d2ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d2f6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.666501:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855698.666503:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855698.666505:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855698.666531:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855698.666533:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855698.666535:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855698.666554:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486214016:0@lo:103: 00000100:00100000:2.0:1787855698.666590:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855698.666669:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486214144:0@lo:103: 00000100:00100000:2.0:1787855698.666692:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855698.666755:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc256580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1874702486213632:0@lo:104: 00000100:00100000:1.0:1787855698.666765:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1874702486213760:0@lo:104: 00000100:00100000:1.0:1787855698.666772:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc255680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1874702486213888:0@lo:104: 00010000:00010000:1.0:1787855698.666818:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a73c166d600/0x516929ca3366d3dd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855698.667090:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787855698.667097:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb676940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486214272:0@lo:103: 00000100:00100000:2.0:1787855698.667125:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855698.667168:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486214016 00000100:00100000:0.0:1787855698.667174:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486214016 00010000:00010000:0.0:1787855698.667198:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c166dc00/0x516929ca3366d382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d37b expref: 13 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855698.667228:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486214144 00000100:00100000:0.0:1787855698.667231:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486214144 00010000:00010000:0.0:1787855698.667242:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a7402047800/0x516929ca3366d312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d30b expref: 14 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855698.667255:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787855698.667262:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:3307:x1874702486214016:12345-0@lo:103: 00010000:00010000:0.0:1787855698.667272:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855698.667277:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c166dc00/0x516929ca3366d382 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d37b expref: 14 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.667287:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c166dc00/0x516929ca3366d382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d37b expref: 14 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.667301:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c166dc00/0x516929ca3366d382 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d37b expref: 14 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.667326:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855698.667375:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:3307:x1874702486214016:12345-0@lo:103: Request processed in 113us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855698.667382:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787855698.667397:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787855698.667403:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:3304:x1874702486214144:12345-0@lo:103: 00010000:00010000:0.0:1787855698.667410:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855698.667415:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a7402047800/0x516929ca3366d312 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d30b expref: 12 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.667424:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a7402047800/0x516929ca3366d312 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d30b expref: 12 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.667434:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402047800/0x516929ca3366d312 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d30b expref: 12 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.667444:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855698.667465:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:3304:x1874702486214144:12345-0@lo:103: Request processed in 62us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855698.667471:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787855698.668046:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486214144:0@lo:103: 00000100:00100000:2.0:1787855698.668089:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486214016:0@lo:103: 00000100:00100000:0.0:1787855698.668136:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486214272 00000100:00100000:0.0:1787855698.668141:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486214272 00010000:00010000:0.0:1787855698.668157:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a7402173800/0x516929ca3366d2f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d2ef expref: 11 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855698.668186:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787855698.668194:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:3304:x1874702486214272:12345-0@lo:103: 00010000:00010000:0.0:1787855698.668201:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855698.668206:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a7402173800/0x516929ca3366d2f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d2ef expref: 11 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.668224:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a7402173800/0x516929ca3366d2f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d2ef expref: 11 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.668235:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402173800/0x516929ca3366d2f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d2ef expref: 11 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.668247:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a73c166d600/0x516929ca3366d3dd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.668255:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c166d600/0x516929ca3366d3dd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.668270:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73c166d600/0x516929ca3366d3dd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.668276:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73c166d600/0x516929ca3366d3dd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.668282:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a73c166d600/0x516929ca3366d3dd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.668289:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a73c166d600/0x516929ca3366d3dd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.668294:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166d600 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855698.668297:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a73c166d600/0x516929ca3366d3dd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.668304:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a73c166d600/0x516929ca3366d3dd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.668435:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a73c166d600/0x516929ca3366d3dd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.668446:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855698.668493:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+10:3304:x1874702486214272:12345-0@lo:103: Request processed in 300us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855698.668500:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787855698.668548:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a73c166d600/0x516929ca3366d3dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.668557:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a73c166d600/0x516929ca3366d3dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.668564:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c166d600/0x516929ca3366d3dd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787855698.668580:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787855698.668706:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb676940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486214272:0@lo:103: 00010000:00010000:2.0:1787855698.686720:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855698.710954:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+9:6676:x1874702486213504:12345-0@lo:253: Request processed in 65891us (66342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855698.710968:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787855698.711053:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486213504:0@lo:253: 10000000:01000000:3.0:1787855698.711067:0:6676:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787855698.711071:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787855698.711072:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787855698.711073:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787855698.711075:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787855698.711076:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787855698.711077:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787855698.711078:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787855698.711080:0:6676:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787855698.711082:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787855698.711083:0:6676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787855698.711104:0:6676:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a73d0d01000 from lustre-OST0000 10000000:01000000:3.0:1787855698.711141:0:6676:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787855698.711144:0:6676:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787855698.711150:0:6676:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a73c44919d0 local copy 10000000:01000000:3.0:1787855698.711154:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787855698.711187:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402172e00/0x516929ca3366d3e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.711198:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.138@tcp lock: ffff9a7402172e00/0x516929ca3366d3e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.711207:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a7402172e00/0x516929ca3366d3e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855698.711224:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486214400:0@lo:101: 00000100:00100000:3.0:1787855698.711263:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855698.711566:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787855698.711808:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486214400 00000100:00100000:2.0:1787855698.711815:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486214400 00000100:00100000:2.0:1787855698.711897:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787855698.711907:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+9:6676:x1874702486214400:12345-0@lo:101: 00010000:00010000:2.0:1787855698.711919:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855698.711935:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402047600/0x516929ca3366d3eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d3e4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.711958:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402047600/0x516929ca3366d3eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d3e4 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.711968:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402047600/0x516929ca3366d3eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d3e4 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.711976:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402047600, rc 0) 00000100:00100000:2.0:1787855698.712020:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+10:6676:x1874702486214400:12345-0@lo:101: Request processed in 115us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855698.712027:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787855698.712096:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486214400:0@lo:101: 00010000:00010000:3.0:1787855698.712109:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a7402172e00/0x516929ca3366d3e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x516929ca3366d3eb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.712117:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a7402172e00/0x516929ca3366d3e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x516929ca3366d3eb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855698.712230:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486214528:0@lo:501: 00000100:00100000:3.0:1787855698.712257:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855698.712361:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0240 going to sleep for 11 seconds 00000100:00100000:1.0:1787855698.712462:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486214528 00000100:00100000:1.0:1787855698.712467:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486214528 00000100:00100000:1.0:1787855698.712501:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787855698.712508:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+10:6676:x1874702486214528:12345-0@lo:501: 00000100:00100000:1.0:1787855698.712796:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+10:6676:x1874702486214528:12345-0@lo:501: Request processed in 268us (518us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787855698.712814:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787855698.713088:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486214528:0@lo:501: 10000000:01000000:3.0:1787855698.713104:0:6676:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787855698.713134:0:6676:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787855698.713147:0:6676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402172e00/0x516929ca3366d3e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x516929ca3366d3eb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.713155:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402172e00/0x516929ca3366d3e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x516929ca3366d3eb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.713162:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff9a7402172e00/0x516929ca3366d3e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x516929ca3366d3eb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.713187:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787855698.713211:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a73d0d01000 10000000:01000000:3.0:1787855698.713216:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787855698.713222:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a73c44919d0 10000000:01000000:3.0:1787855698.713224:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787855698.713228:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a73c44919d0 from 1 10000000:01000000:3.0:1787855698.713230:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787855698.713251:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402172000/0x516929ca3366d3f2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.713259:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a7402172000/0x516929ca3366d3f2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.713267:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a7402172000/0x516929ca3366d3f2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855698.713279:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486214656:0@lo:101: 00000100:00100000:3.0:1787855698.713309:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855698.713327:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0780 going to sleep for 11 seconds 00000100:00100000:3.0:1787855698.713356:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486214656 00000100:00100000:3.0:1787855698.713360:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486214656 00000100:00100000:3.0:1787855698.713381:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787855698.713397:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+10:6676:x1874702486214656:12345-0@lo:101: 00010000:00010000:3.0:1787855698.713405:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855698.713415:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402172400/0x516929ca3366d3f9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d3f2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.713615:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402172400/0x516929ca3366d3f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d3f2 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.713625:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402172400/0x516929ca3366d3f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d3f2 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.713633:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402172400, rc 0) 00000100:00100000:3.0:1787855698.713665:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:6676:x1874702486214656:12345-0@lo:101: Request processed in 270us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855698.713670:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787855698.713703:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486214656:0@lo:101: 00010000:00010000:3.0:1787855698.713714:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a7402172000/0x516929ca3366d3f2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d3f9 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.713722:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a7402172000/0x516929ca3366d3f2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d3f9 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855698.713736:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787855698.713746:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402172000/0x516929ca3366d3f2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d3f9 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.713753:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a7402172000/0x516929ca3366d3f2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d3f9 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855698.713771:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787855698.713792:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787855698.713796:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787855698.713799:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787855698.713812:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402172200/0x516929ca3366d400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.713821:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a7402172200/0x516929ca3366d400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.713827:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a7402172200/0x516929ca3366d400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855698.713838:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486214784:0@lo:101: 00000100:00100000:3.0:1787855698.713863:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855698.713876:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0780 going to sleep for 11 seconds 00000100:00100000:3.0:1787855698.713890:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486214784 00000100:00100000:3.0:1787855698.713893:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486214784 00000100:00100000:3.0:1787855698.713910:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787855698.713915:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:6676:x1874702486214784:12345-0@lo:101: 00010000:00010000:3.0:1787855698.713922:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855698.713929:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402173400/0x516929ca3366d407 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d400 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.713942:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402173400/0x516929ca3366d407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d400 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.713950:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402173400/0x516929ca3366d407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d400 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.713963:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402173400, rc 0) 00000100:00100000:3.0:1787855698.713991:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6676:x1874702486214784:12345-0@lo:101: Request processed in 75us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855698.713997:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787855698.714026:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486214784:0@lo:101: 00010000:00010000:3.0:1787855698.714037:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a7402172200/0x516929ca3366d400 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d407 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.714044:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a7402172200/0x516929ca3366d400 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d407 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855698.714109:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486214912:0@lo:501: 00000100:00100000:3.0:1787855698.714134:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855698.714148:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0780 going to sleep for 11 seconds 00000100:00100000:3.0:1787855698.714160:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486214912 00000100:00100000:3.0:1787855698.714164:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486214912 00000100:00100000:3.0:1787855698.714180:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787855698.714185:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c54dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6676:x1874702486214912:12345-0@lo:501: 00000100:00100000:3.0:1787855698.714395:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c54dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6676:x1874702486214912:12345-0@lo:501: Request processed in 208us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855698.714402:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787855698.714430:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486214912:0@lo:501: 00010000:00010000:1.0:1787855698.714656:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787855698.714663:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402172e00/0x516929ca3366d3e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x516929ca3366d3eb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855698.714670:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402172e00 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:1.0:1787855698.714674:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402172e00/0x516929ca3366d3e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x516929ca3366d3eb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855698.714682:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402172e00/0x516929ca3366d3e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x516929ca3366d3eb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787855698.714690:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402172e00/0x516929ca3366d3e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x516929ca3366d3eb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787855698.714696:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787855698.714718:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402172e00/0x516929ca3366d3e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x516929ca3366d3eb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855698.714724:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787855698.714745:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402172e00/0x516929ca3366d3e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x516929ca3366d3eb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855698.714752:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402172e00/0x516929ca3366d3e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x516929ca3366d3eb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855698.714767:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855698.714769:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855698.714771:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855698.714915:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc255680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486215040:0@lo:103: 00000100:00100000:2.0:1787855698.714952:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855698.715032:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486215040 00000100:00100000:1.0:1787855698.715044:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486215040 00000100:00100000:1.0:1787855698.715088:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787855698.715096:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:3306:x1874702486215040:12345-0@lo:103: 00010000:00010000:1.0:1787855698.715105:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855698.715118:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402047600/0x516929ca3366d3eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x516929ca3366d3e4 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855698.715127:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855698.715153:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:3306:x1874702486215040:12345-0@lo:103: Request processed in 59us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855698.715159:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787855698.715221:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc255680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486215040:0@lo:103: 00000100:00100000:3.0:1787855698.715311:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486215168:0@lo:503: 00000100:00100000:3.0:1787855698.715361:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855698.715417:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c96daa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787855698.715670:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486215168 00000100:00100000:0.0:1787855698.715675:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486215168 00000100:00100000:2.0:1787855698.715724:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787855698.715732:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:6676:x1874702486215168:12345-0@lo:503: 00000100:00100000:2.0:1787855698.716032:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:6676:x1874702486215168:12345-0@lo:503: Request processed in 301us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855698.716039:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787855698.716198:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486215168:0@lo:503: 00000040:00080000:3.0:1787855698.716686:0:6676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787855698.716766:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486215296:0@lo:502: 00000100:00100000:3.0:1787855698.716946:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855698.717022:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c96daa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787855698.717069:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486215296 00000100:00100000:2.0:1787855698.717074:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486215296 00000100:00100000:2.0:1787855698.717150:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787855698.717160:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:6676:x1874702486215296:12345-0@lo:502: 00000100:00100000:2.0:1787855698.717325:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:6676:x1874702486215296:12345-0@lo:502: Request processed in 166us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855698.717332:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787855698.717414:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486215296:0@lo:502: 00000040:00080000:3.0:1787855698.717695:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787855698.717757:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787855698.717833:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787855698.717881:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787855698.717915:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787855698.717950:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787855698.717975:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486215424:0@lo:502: 00000100:00100000:3.0:1787855698.718012:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855698.718657:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c96daa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787855698.718732:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486215424 00000100:00100000:0.0:1787855698.718739:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486215424 00000100:00100000:0.0:1787855698.718792:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787855698.718802:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:6676:x1874702486215424:12345-0@lo:502: 00000100:00100000:0.0:1787855698.718992:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:6676:x1874702486215424:12345-0@lo:502: Request processed in 191us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855698.719000:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787855698.719102:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486215424:0@lo:502: 00000040:00080000:3.0:1787855698.719216:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787855698.719229:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1787855698.720109:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787855698.720119:0:6694:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787855698.720125:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787855698.720128:0:6694:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787855698.720135:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787855698.720151:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a73c4490000) 00000020:00000080:2.0:1787855698.720171:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787855698.720177:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787855698.720236:0:6694:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a73d0d01000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787855698.720244:0:6694:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787855698.720251:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x516929ca3366d415 00010000:00010000:3.0:1787855698.727009:0:6694:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787855698.727303:0:6694:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787855698.729728:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787855698.730077:0:6694:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787855698.737766:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787855698.739277:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787855698.741358:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787855698.741369:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787855698.741376:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787855698.741378:0:6694:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787855698.741382:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787855698.741386:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787855698.741387:0:6694:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787855698.741390:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787855698.741392:0:6694:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787855698.741460:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787855698.741464:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787855698.741465:0:6694:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787855698.741468:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787855698.743667:0:6676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787855698.743706:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787855698.743725:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402172200/0x516929ca3366d400 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d407 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.743745:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a7402172200/0x516929ca3366d400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d407 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855698.743753:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73d0d01000 from 1 10000000:01000000:3.0:1787855698.743756:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787855698.743811:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402173200/0x516929ca3366d41c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.743819:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a7402173200/0x516929ca3366d41c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.743830:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a7402173200/0x516929ca3366d41c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855698.743853:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486215552:0@lo:101: 00000100:00100000:3.0:1787855698.743919:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855698.750408:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80fa480 going to sleep for 11 seconds 00000100:00100000:0.0:1787855698.754130:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486215552 00000100:00100000:0.0:1787855698.754142:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486215552 00000100:00100000:0.0:1787855698.754225:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787855698.754236:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:6676:x1874702486215552:12345-0@lo:101: 00010000:00010000:0.0:1787855698.754255:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855698.754272:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c0031600/0x516929ca3366d423 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d41c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.754299:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c0031600/0x516929ca3366d423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d41c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.754309:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c0031600/0x516929ca3366d423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d41c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.754330:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c0031600, rc 0) 00000100:00100000:0.0:1787855698.754417:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6676:x1874702486215552:12345-0@lo:101: Request processed in 183us (10498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855698.754425:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787855698.754520:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486215552:0@lo:101: 00010000:00010000:3.0:1787855698.754538:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a7402173200/0x516929ca3366d41c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d423 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.754547:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a7402173200/0x516929ca3366d41c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d423 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855698.754656:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486215680:0@lo:501: 00000100:00100000:3.0:1787855698.754690:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855698.757741:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80fa480 going to sleep for 11 seconds 00000100:00100000:0.0:1787855698.757963:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486215680 00000100:00100000:0.0:1787855698.757973:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486215680 00000100:00100000:0.0:1787855698.758047:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787855698.758056:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6676:x1874702486215680:12345-0@lo:501: 00000100:00100000:0.0:1787855698.758359:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6676:x1874702486215680:12345-0@lo:501: Request processed in 303us (3667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855698.758367:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787855698.758473:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486215680:0@lo:501: 00000100:00100000:3.0:1787855698.758690:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486215808:0@lo:503: 00000100:00100000:3.0:1787855698.758735:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855698.758764:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80fa480 going to sleep for 11 seconds 00000100:00100000:2.0:1787855698.758962:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486215808 00000100:00100000:2.0:1787855698.758968:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486215808 00000100:00100000:2.0:1787855698.758991:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787855698.758998:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6676:x1874702486215808:12345-0@lo:503: 00000100:00100000:2.0:1787855698.759290:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6676:x1874702486215808:12345-0@lo:503: Request processed in 291us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855698.759296:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787855698.759387:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486215808:0@lo:503: 00000040:00080000:3.0:1787855698.759899:0:6676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787855698.759971:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486215936:0@lo:502: 00000100:00100000:3.0:1787855698.760015:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855698.760045:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80fa480 going to sleep for 11 seconds 00000100:00100000:0.0:1787855698.760123:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486215936 00000100:00100000:0.0:1787855698.760129:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486215936 00000100:00100000:0.0:1787855698.760154:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787855698.760162:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6676:x1874702486215936:12345-0@lo:502: 00000100:00100000:0.0:1787855698.760341:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6676:x1874702486215936:12345-0@lo:502: Request processed in 171us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855698.760349:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787855698.760614:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486215936:0@lo:502: 00000040:00080000:3.0:1787855698.760889:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787855698.760936:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787855698.760961:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486216064:0@lo:502: 00000100:00100000:3.0:1787855698.761000:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855698.761021:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80fa480 going to sleep for 11 seconds 00000100:00100000:2.0:1787855698.761114:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486216064 00000100:00100000:2.0:1787855698.761120:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486216064 00000100:00100000:2.0:1787855698.761145:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787855698.761151:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6676:x1874702486216064:12345-0@lo:502: 00000100:00100000:2.0:1787855698.761283:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6676:x1874702486216064:12345-0@lo:502: Request processed in 131us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855698.761290:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787855698.761417:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486216064:0@lo:502: 00000040:00080000:3.0:1787855698.761716:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787855698.761726:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787855698.762669:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787855698.762680:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855698.762682:0:6698:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787855698.762688:0:6698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a73d0d01000 00000020:00000080:3.0:1787855698.762690:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787855698.762707:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787855698.762710:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855698.762712:0:6698:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787855698.762714:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787855698.762985:0:6676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787855698.763006:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787855698.763056:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402173200/0x516929ca3366d41c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d423 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.763068:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a7402173200/0x516929ca3366d41c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d423 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855698.763109:0:6676:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787855698.763118:0:6676:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a73d0d01000 10000000:01000000:0.0:1787855698.763121:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a73d0d01000 10000000:01000000:0.0:1787855698.763125:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787855698.763130:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a73d0d01000 from 1 10000000:01000000:0.0:1787855698.763133:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787855698.763163:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c0031800/0x516929ca3366d42a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.763170:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c0031800/0x516929ca3366d42a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.763180:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c0031800/0x516929ca3366d42a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855698.763197:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb677c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486216192:0@lo:101: 00000100:00100000:0.0:1787855698.763258:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855698.763324:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d07d5600 going to sleep for 11 seconds 00000100:00100000:3.0:1787855698.763392:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486216192 00000100:00100000:3.0:1787855698.763398:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486216192 00000100:00100000:3.0:1787855698.763475:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787855698.763662:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6676:x1874702486216192:12345-0@lo:101: 00010000:00010000:3.0:1787855698.763673:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855698.763684:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402172e00/0x516929ca3366d431 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d42a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.763706:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402172e00/0x516929ca3366d431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d42a expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.763716:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402172e00/0x516929ca3366d431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d42a expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855698.763723:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402172e00, rc 0) 00000100:00100000:3.0:1787855698.763771:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:6676:x1874702486216192:12345-0@lo:101: Request processed in 113us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855698.763804:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787855698.763905:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb677c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486216192:0@lo:101: 00010000:00010000:1.0:1787855698.763919:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c0031800/0x516929ca3366d42a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d431 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855698.763928:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c0031800/0x516929ca3366d42a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d431 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855698.764020:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486216320:0@lo:501: 00000100:00100000:1.0:1787855698.764048:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855698.764177:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0240 going to sleep for 11 seconds 00000100:00100000:0.0:1787855698.764234:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486216320 00000100:00100000:0.0:1787855698.764240:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486216320 00000100:00100000:0.0:1787855698.764260:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787855698.764267:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:6676:x1874702486216320:12345-0@lo:501: 00000100:00100000:0.0:1787855698.764674:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:6676:x1874702486216320:12345-0@lo:501: Request processed in 406us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855698.764682:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787855698.764756:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486216320:0@lo:501: 00000100:00100000:1.0:1787855698.764811:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486216448:0@lo:503: 00000100:00100000:1.0:1787855698.764850:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855698.764861:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787855698.764903:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486216448 00000100:00100000:3.0:1787855698.764908:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486216448 00000100:00100000:3.0:1787855698.764930:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787855698.764935:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:6676:x1874702486216448:12345-0@lo:503: 00000100:00100000:3.0:1787855698.765113:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:6676:x1874702486216448:12345-0@lo:503: Request processed in 176us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855698.765119:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787855698.765354:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486216448:0@lo:503: 00000040:00080000:1.0:1787855698.766074:0:6676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787855698.766137:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486216576:0@lo:502: 00000100:00100000:1.0:1787855698.766188:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855698.766252:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787855698.766299:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486216576 00000100:00100000:3.0:1787855698.766305:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486216576 00000100:00100000:3.0:1787855698.766349:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787855698.766356:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:6676:x1874702486216576:12345-0@lo:502: 00000100:00100000:3.0:1787855698.766837:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:6676:x1874702486216576:12345-0@lo:502: Request processed in 480us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855698.766845:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787855698.767088:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486216576:0@lo:502: 00000040:00080000:1.0:1787855698.767322:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787855698.767383:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787855698.767416:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787855698.767458:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787855698.767671:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787855698.767725:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787855698.767758:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787855698.767963:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787855698.768019:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787855698.768056:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787855698.768090:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787855698.768139:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787855698.768175:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787855698.768210:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787855698.768282:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787855698.768320:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787855698.768366:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787855698.768416:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787855698.768637:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787855698.768672:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787855698.768716:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787855698.768749:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787855698.768928:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787855698.768982:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787855698.769024:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787855698.769058:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787855698.769120:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787855698.769166:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1787855698.769209:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486216704:0@lo:502: 00000100:00100000:1.0:1787855698.769279:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855698.769369:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787855698.769423:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486216704 00000100:00100000:2.0:1787855698.769613:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486216704 00000100:00100000:2.0:1787855698.769712:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787855698.769722:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:6676:x1874702486216704:12345-0@lo:502: 00000100:00100000:2.0:1787855698.770090:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:6676:x1874702486216704:12345-0@lo:502: Request processed in 368us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855698.770098:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787855698.770218:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486216704:0@lo:502: 00000040:00080000:3.0:1787855698.770298:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787855698.770309:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787855698.771035:0:6699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787855698.771051:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a73d06e4d70) 00000020:00000080:3.0:1787855698.771073:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787855698.771149:0:6699:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a73d0d01000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787855698.771153:0:6699:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a73d0d01000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787855698.771156:0:6699:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a73d0d01000 3 00010000:00080000:3.0:1787855698.771195:0:6699:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a73d0d07800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.138@tcp at head 00010000:00010000:3.0:1787855698.774986:0:6699:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1787855698.775233:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787855698.775269:0:6699:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787855698.775281:0:6699:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x516929ca3366d43f 00000100:00080000:3.0:1787855698.775292:0:6699:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787855698.775297:0:6699:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a73d0d07800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1787855698.775343:0:6699:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73cb7a5e00 x1874702486216832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787855698.775406:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874702486216832:0@lo:38: 00000100:00100000:0.0:1787855698.775497:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855698.775589:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486216832 00000100:00100000:2.0:1787855698.775596:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486216832 00000100:00100000:2.0:1787855698.775630:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787855698.775639:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb674b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874702486216832:12345-0@lo:38: 00010000:00080000:2.0:1787855698.775668:0:5835:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:2.0:1787855698.775694:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x516929ca3366d446 00000004:00100000:2.0:1787855698.775706:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787855698.775735:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9a73d22e8000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787855698.776016:0:6699:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787855698.780656:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb674b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874702486216832:12345-0@lo:38: Request processed in 5008us (5150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855698.780670:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787855698.782715:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a73cb7a5e00 x1874702486216832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787855708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855698.782730:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787855698.782748:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1787855698.782757:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787855698.782763:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787855698.782766:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73d0d07800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787855698.782796:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874702486216832:0@lo:38: 00000040:00080000:3.0:1787855698.783112:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1787855698.783354:0:6676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787855698.783378:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787855698.783399:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c0031800/0x516929ca3366d42a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d431 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.783410:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c0031800/0x516929ca3366d42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d431 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787855698.783677:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787855698.783679:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787855698.783680:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787855698.783682:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787855698.783683:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787855698.783684:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787855698.783686:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787855698.783688:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787855698.783689:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787855698.783691:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787855698.783692:0:6676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787855698.783696:0:6676:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787855698.783699:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787855698.783700:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787855698.783701:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787855698.783702:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787855698.783704:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787855698.783705:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787855698.783706:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787855698.783707:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787855698.783708:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787855698.783714:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787855698.783715:0:6676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787855698.783748:0:6676:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787855698.783765:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6752c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486216960:0@lo:253: 00000100:00100000:0.0:1787855698.783977:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855698.784022:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d07d5540 going to sleep for 11 seconds 00000100:00100000:3.0:1787855698.785137:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486216960 00000100:00100000:3.0:1787855698.785146:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486216960 00000100:00100000:3.0:1787855698.785198:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787855698.785207:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:6676:x1874702486216960:12345-0@lo:253: 20000000:01000000:3.0:1787855698.785248:0:5827:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787855698.785262:0:5827:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787855698.810949:0:5827:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787855698.810972:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787855698.811140:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787855698.811145:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787855698.811165:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a7402047e00/0x516929ca3366d44d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.811185:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c0031000/0x516929ca3366d3a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d39e expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.811192:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a7402047e00/0x516929ca3366d44d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.811229:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c0031000/0x516929ca3366d3a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d39e expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.811244:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a73c0031000/0x516929ca3366d3a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d39e expref: 13 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855698.811257:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6f6d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874702486217088:0@lo:104: 00000100:00100000:2.0:1787855698.811320:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855698.811381:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c53ef000 going to sleep for 11 seconds 00000100:00100000:0.0:1787855698.811471:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486217088 00000100:00100000:0.0:1787855698.811598:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486217088 00000100:00100000:0.0:1787855698.811651:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787855698.811660:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:5849:x1874702486217088:12345-0@lo:104: 00010000:00010000:0.0:1787855698.811672:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a7402046200/0x516929ca3366d39e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d3a5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855698.811722:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787855698.811727:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:5849:x1874702486217088:12345-0@lo:104: Request processed in 69us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855698.811733:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787855698.811928:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855698.811935:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402046200/0x516929ca3366d39e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d3a5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.811954:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402046200 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:2.0:1787855698.811958:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402046200/0x516929ca3366d39e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d3a5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.811965:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402046200/0x516929ca3366d39e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d3a5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787855698.811971:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402046200/0x516929ca3366d39e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d3a5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855698.811976:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787855698.812023:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402046200/0x516929ca3366d39e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d3a5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.812029:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787855698.812047:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402046200/0x516929ca3366d39e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d3a5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.812052:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402046200/0x516929ca3366d39e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d3a5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.812069:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855698.812071:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855698.812072:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855698.812086:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7423840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486217216:0@lo:103: 00000100:00100000:2.0:1787855698.812119:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855698.812165:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486217216 00000100:00100000:2.0:1787855698.812169:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486217216 00010000:00010000:2.0:1787855698.812187:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c0031000/0x516929ca3366d3a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d39e expref: 14 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855698.812218:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787855698.812224:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c53da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:3307:x1874702486217216:12345-0@lo:103: 00010000:00010000:2.0:1787855698.812235:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855698.812240:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c0031000/0x516929ca3366d3a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d39e expref: 14 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.812248:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c0031000/0x516929ca3366d3a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d39e expref: 14 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.812262:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a7402047e00/0x516929ca3366d44d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.812269:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402047e00/0x516929ca3366d44d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787855698.812281:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002294828s 00010000:00010000:2.0:1787855698.812284:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a7402047e00/0x516929ca3366d44d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.812291:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a7402047e00/0x516929ca3366d44d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.812297:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a7402047e00/0x516929ca3366d44d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.812303:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a7402047e00/0x516929ca3366d44d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.812309:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402047e00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:2.0:1787855698.812312:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a7402047e00/0x516929ca3366d44d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.812326:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a7402047e00/0x516929ca3366d44d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.812345:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a7402047e00/0x516929ca3366d44d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.812355:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855698.812389:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c53da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:3307:x1874702486217216:12345-0@lo:103: Request processed in 165us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855698.812397:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787855698.812470:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7423840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486217216:0@lo:103: 00010000:00010000:2.0:1787855698.812670:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c0031000/0x516929ca3366d3a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d39e expref: 13 pid: 5827 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855698.812680:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6f6d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874702486217088:0@lo:104: 00010000:00010000:2.0:1787855698.812692:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a7402047e00/0x516929ca3366d44d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.812700:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a7402047e00/0x516929ca3366d44d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.812706:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a7402047e00/0x516929ca3366d44d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855698.812713:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402047e00/0x516929ca3366d44d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855698.822962:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:6676:x1874702486216960:12345-0@lo:253: Request processed in 37746us (38975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855698.822977:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787855698.823061:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6752c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:6676:1874702486216960:0@lo:253: 10000000:01000000:0.0:1787855698.823077:0:6676:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787855698.823080:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787855698.823082:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787855698.823083:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787855698.823084:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787855698.823086:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787855698.823087:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787855698.823089:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787855698.823090:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787855698.823091:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787855698.823093:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787855698.823094:0:6676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787855698.823110:0:6676:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787855698.828724:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787855698.828978:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787855698.829205:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787855698.829386:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787855698.830113:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787855698.830342:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787855698.831680:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787855699.067223:0:6676:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787855699.067230:0:6676:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787855699.067262:0:6676:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787855699.067321:0:6676:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787855699.067344:0:6676:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787855699.067373:0:6676:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787855699.709493:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855700.732042:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855701.756414:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855702.780502:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787855703.689192:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787855703.689202:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a73f4b59000 from 21 10000000:01000000:3.0:1787855703.689208:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787855703.689288:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402173800/0x516929ca3366d454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855703.689301:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a7402173800/0x516929ca3366d454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855703.689312:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a7402173800/0x516929ca3366d454 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855703.689338:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486217344:0@lo:101: 00000100:00100000:3.0:1787855703.689407:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855703.689486:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d12186c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855703.691992:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486217344 00000100:00100000:2.0:1787855703.692007:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486217344 00000100:00100000:2.0:1787855703.692083:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787855703.692093:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5830:x1874702486217344:12345-0@lo:101: 00010000:00010000:2.0:1787855703.692109:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855703.692128:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402046e00/0x516929ca3366d45b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d454 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855703.692162:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402046e00/0x516929ca3366d45b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d454 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855703.692173:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402046e00/0x516929ca3366d45b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d454 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855703.692182:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402046e00, rc 0) 00000100:00100000:2.0:1787855703.692270:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:5830:x1874702486217344:12345-0@lo:101: Request processed in 179us (2863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855703.692277:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787855703.693379:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486217344:0@lo:101: 00010000:00010000:3.0:1787855703.693401:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a7402173800/0x516929ca3366d454 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d45b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855703.693411:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a7402173800/0x516929ca3366d454 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d45b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855703.693479:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486217472:0@lo:501: 00000100:00100000:3.0:1787855703.693522:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855703.693553:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d12186c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855703.695898:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486217472 00000100:00100000:2.0:1787855703.695912:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486217472 00000100:00100000:2.0:1787855703.695976:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787855703.695986:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:5830:x1874702486217472:12345-0@lo:501: 00000100:00100000:2.0:1787855703.696456:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:5830:x1874702486217472:12345-0@lo:501: Request processed in 471us (2933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855703.696466:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787855703.698279:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486217472:0@lo:501: 00000100:00100000:0.0:1787855703.698345:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb675a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486217600:0@lo:503: 00000100:00100000:0.0:1787855703.698473:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855703.698525:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d0b43840 going to sleep for 11 seconds 00000100:00100000:3.0:1787855703.698631:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486217600 00000100:00100000:3.0:1787855703.698638:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486217600 00000100:00100000:3.0:1787855703.698692:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787855703.698702:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:5830:x1874702486217600:12345-0@lo:503: 00000100:00100000:3.0:1787855703.699154:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:5830:x1874702486217600:12345-0@lo:503: Request processed in 453us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855703.699162:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787855703.702033:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb675a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486217600:0@lo:503: 00000100:00100000:2.0:1787855703.702832:0:6975:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74230c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:6975:1874702486217728:0@lo:502: 00000100:00100000:2.0:1787855703.702915:0:6975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855703.702969:0:6975:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa19f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787855703.703129:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486217728 00000100:00100000:3.0:1787855703.703136:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486217728 00000100:00100000:3.0:1787855703.703190:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787855703.703200:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:6975:x1874702486217728:12345-0@lo:502: 00000100:00100000:3.0:1787855703.703509:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:6975:x1874702486217728:12345-0@lo:502: Request processed in 310us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855703.703517:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787855703.704437:0:6975:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74230c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:6975:1874702486217728:0@lo:502: 00000100:00100000:2.0:1787855703.704515:0:6975:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74230c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:6975:1874702486217856:0@lo:502: 00000100:00100000:2.0:1787855703.704573:0:6975:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855703.706965:0:6975:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa19f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855703.715913:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486217856 00000100:00100000:0.0:1787855703.715928:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486217856 00000100:00100000:0.0:1787855703.715995:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787855703.716006:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:6975:x1874702486217856:12345-0@lo:502: 00000100:00100000:0.0:1787855703.717953:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:6975:x1874702486217856:12345-0@lo:502: Request processed in 1940us (13370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855703.717968:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787855703.730457:0:6975:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74230c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:6975:1874702486217856:0@lo:502: 00000040:00080000:2.0:1787855703.730514:0:6975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787855703.732130:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787855703.732164:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787855703.732175:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402173800/0x516929ca3366d454 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d45b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855703.732187:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a7402173800/0x516929ca3366d454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d45b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855703.732197:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787855703.732200:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a73f4b59000 from 4 10000000:01000000:3.0:1787855703.732203:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787855703.732243:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402173a00/0x516929ca3366d462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855703.732261:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a7402173a00/0x516929ca3366d462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855703.732287:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a7402173a00/0x516929ca3366d462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855703.732313:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486217984:0@lo:101: 00000100:00100000:3.0:1787855703.732381:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855703.732437:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d0f37840 going to sleep for 11 seconds 00000100:00100000:2.0:1787855703.732494:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486217984 00000100:00100000:2.0:1787855703.732501:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486217984 00000100:00100000:2.0:1787855703.732551:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787855703.732561:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:5830:x1874702486217984:12345-0@lo:101: 00010000:00010000:2.0:1787855703.732573:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855703.732586:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402046600/0x516929ca3366d469 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d462 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855703.732608:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402046600/0x516929ca3366d469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d462 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855703.732618:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402046600/0x516929ca3366d469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d462 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855703.732626:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402046600, rc 0) 00000100:00100000:2.0:1787855703.732674:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:5830:x1874702486217984:12345-0@lo:101: Request processed in 115us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855703.732681:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787855703.732725:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486217984:0@lo:101: 00010000:00010000:2.0:1787855703.732738:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a7402173a00/0x516929ca3366d462 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d469 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855703.732746:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a7402173a00/0x516929ca3366d462 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d469 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855703.732815:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74230c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486218112:0@lo:256: 00000100:00100000:2.0:1787855703.732843:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855703.732858:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa19fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787855703.732870:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486218112 00000100:00100000:2.0:1787855703.732873:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486218112 00000100:00100000:2.0:1787855703.732894:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787855703.732900:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:5830:x1874702486218112:12345-0@lo:256: 20000000:01000000:2.0:1787855703.732912:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787855703.732927:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787855703.732930:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787855703.733002:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:5830:x1874702486218112:12345-0@lo:256: Request processed in 101us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855703.733008:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787855703.733051:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74230c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486218112:0@lo:256: 10000000:01000000:2.0:1787855703.733091:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787855703.733097:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402173a00/0x516929ca3366d462 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d469 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855703.733113:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a7402173a00/0x516929ca3366d462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d469 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855703.733121:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787855703.733122:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787855703.733125:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787855703.733141:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402046400/0x516929ca3366d470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855703.733148:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a7402046400/0x516929ca3366d470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855703.733155:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a7402046400/0x516929ca3366d470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855703.733166:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74230c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486218240:0@lo:101: 00000100:00100000:2.0:1787855703.733188:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855703.733201:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa19fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787855703.733211:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486218240 00000100:00100000:2.0:1787855703.733214:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486218240 00000100:00100000:2.0:1787855703.733234:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787855703.733240:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:5830:x1874702486218240:12345-0@lo:101: 00010000:00010000:2.0:1787855703.733246:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855703.733265:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402047200/0x516929ca3366d477 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d470 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855703.733277:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402047200/0x516929ca3366d477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d470 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855703.733296:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402047200/0x516929ca3366d477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d470 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855703.733303:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402047200, rc 0) 00000100:00100000:2.0:1787855703.733332:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486218240:12345-0@lo:101: Request processed in 92us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855703.733338:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787855703.733365:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74230c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486218240:0@lo:101: 00010000:00010000:2.0:1787855703.733375:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a7402046400/0x516929ca3366d470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d477 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855703.733382:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a7402046400/0x516929ca3366d470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d477 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855703.733422:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74230c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486218368:0@lo:501: 00000100:00100000:2.0:1787855703.733444:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855703.733458:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa19fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787855703.733468:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486218368 00000100:00100000:2.0:1787855703.733471:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486218368 00000100:00100000:2.0:1787855703.733490:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787855703.733496:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486218368:12345-0@lo:501: 00000100:00100000:2.0:1787855703.733729:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486218368:12345-0@lo:501: Request processed in 232us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855703.733735:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787855703.733761:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74230c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486218368:0@lo:501: 00000100:00100000:2.0:1787855703.733807:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74230c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486218496:0@lo:503: 00000100:00100000:2.0:1787855703.733846:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855703.733861:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa19fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787855703.733871:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486218496 00000100:00100000:2.0:1787855703.733874:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486218496 00000100:00100000:2.0:1787855703.733894:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787855703.733900:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486218496:12345-0@lo:503: 00000100:00100000:2.0:1787855703.734169:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486218496:12345-0@lo:503: Request processed in 268us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855703.734175:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787855703.734210:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74230c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486218496:0@lo:503: 00000100:00100000:2.0:1787855703.734386:0:6978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74230c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:6978:1874702486218624:0@lo:502: 00000100:00100000:2.0:1787855703.734430:0:6978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855703.734448:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486218624 00000100:00100000:2.0:1787855703.734452:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486218624 00000100:00100000:2.0:1787855703.734471:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787855703.734476:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:6978:x1874702486218624:12345-0@lo:502: 00000100:00100000:2.0:1787855703.734646:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:6978:x1874702486218624:12345-0@lo:502: Request processed in 169us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855703.734652:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787855703.734678:0:6978:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa19f540 going to sleep for 11 seconds 00000100:00100000:2.0:1787855703.734689:0:6978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74230c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:6978:1874702486218624:0@lo:502: 00000020:01000000:2.0:1787855703.734708:0:6978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787855703.734715:0:6978:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787855703.734721:0:6978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787855703.734723:0:6978:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787855703.734728:0:6978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787855703.734736:0:6978:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:01000000:2.0:1787855703.734758:0:6978:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787855703.734760:0:6978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787855703.734804:0:6978:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a74004ccd70) 00000020:00000080:2.0:1787855703.734823:0:6978:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787855703.734829:0:6978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787855703.734895:0:6978:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787855703.734900:0:6978:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787855703.734916:0:6978:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x516929ca3366d485 00010000:00080000:2.0:1787855703.734942:0:6978:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a740049b000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:2.0:1787855703.735171:0:6978:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:1.0:1787855703.808883:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787855703.861536:0:6978:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787855703.861562:0:6978:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787855703.863059:0:6978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787855703.863289:0:6978:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787855703.863495:0:6978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787855703.863571:0:6978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787855703.864043:0:6982:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787855703.864049:0:6982:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787855703.864949:0:6978:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787855703.865129:0:6978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787855703.865168:0:6978:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787855703.865191:0:6978:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x516929ca3366d48c 00000100:00080000:0.0:1787855703.865201:0:6978:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787855703.865206:0:6978:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a740049b000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1787855703.865241:0:6978:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73cb675a40 x1874702486218752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787855703.865279:0:6978:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1787855703.865370:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb675a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486218752:0@lo:8: 00000100:00100000:2.0:1787855703.865436:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855703.865504:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486218752 00000100:00100000:2.0:1787855703.865509:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486218752 00000100:00100000:2.0:1787855703.865539:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787855703.865546:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1874702486218752:12345-0@lo:8: 00010000:00080000:2.0:1787855703.865569:0:6679:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1787855703.865595:0:6679:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x516929ca3366d493 00002000:00100000:2.0:1787855703.865622:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a740049c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787855703.865627:0:6679:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1787855703.865630:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787855703.865738:0:6679:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787855703.865928:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787855703.865952:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9a740049f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787855703.866017:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874702486218752:12345-0@lo:8: Request processed in 469us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855703.866024:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787855703.866066:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73cb675a40 x1874702486218752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787855713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855703.866076:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787855703.866084:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787855703.866091:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787855703.866096:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787855703.866098:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a740049b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787855703.866113:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787855703.866118:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb675a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486218752:0@lo:8: 00000020:01000000:0.0:1787855703.866414:0:6978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787855703.866419:0:6978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855703.866421:0:6978:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787855703.866425:0:6978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787855703.866436:0:6978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855703.866438:0:6978:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787855703.866442:0:6978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787855703.866444:0:6978:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787855703.866470:0:6978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6752c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:6978:1874702486218880:0@lo:502: 00000100:00100000:0.0:1787855703.866520:0:6978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855703.866551:0:6978:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d064f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787855703.866569:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486218880 00000100:00100000:0.0:1787855703.866574:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486218880 00000100:00100000:0.0:1787855703.866607:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787855703.866615:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:6978:x1874702486218880:12345-0@lo:502: 00000100:00100000:0.0:1787855703.866842:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:6978:x1874702486218880:12345-0@lo:502: Request processed in 227us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855703.866850:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787855703.866898:0:6978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6752c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:6978:1874702486218880:0@lo:502: 00000020:01000000:0.0:1787855703.866917:0:6978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787855703.866921:0:6978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855703.866922:0:6978:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787855703.866926:0:6978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787855703.867152:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787855703.867168:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787855703.867178:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402046400/0x516929ca3366d470 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d477 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855703.867190:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a7402046400/0x516929ca3366d470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d477 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855703.867201:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787855703.867204:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a73c44919d0 from 1 10000000:01000000:0.0:1787855703.867213:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787855703.867237:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c0031400/0x516929ca3366d49a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855703.867256:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c0031400/0x516929ca3366d49a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855703.867266:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c0031400/0x516929ca3366d49a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855703.867278:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6752c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486219008:0@lo:101: 00000100:00100000:0.0:1787855703.867306:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855703.867331:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c60aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787855703.867406:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486219008 00000100:00100000:0.0:1787855703.867411:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486219008 00000100:00100000:0.0:1787855703.867439:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787855703.867445:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486219008:12345-0@lo:101: 00010000:00010000:0.0:1787855703.867454:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855703.867466:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c0031000/0x516929ca3366d4a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d49a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855703.867483:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c0031000/0x516929ca3366d4a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d49a expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855703.867492:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c0031000/0x516929ca3366d4a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d49a expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855703.867500:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c0031000, rc 0) 00000100:00100000:0.0:1787855703.867530:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486219008:12345-0@lo:101: Request processed in 86us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855703.867545:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787855703.867577:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6752c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486219008:0@lo:101: 00010000:00010000:0.0:1787855703.867587:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c0031400/0x516929ca3366d49a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d4a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855703.867596:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c0031400/0x516929ca3366d49a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d4a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855703.867634:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6752c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486219136:0@lo:501: 00000100:00100000:0.0:1787855703.867658:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855703.867671:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c60aeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787855703.867684:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486219136 00000100:00100000:0.0:1787855703.867687:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486219136 00000100:00100000:0.0:1787855703.867707:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787855703.867713:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486219136:12345-0@lo:501: 00000100:00100000:0.0:1787855703.869194:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486219136:12345-0@lo:501: Request processed in 1474us (1528us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787855703.869206:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787855703.869303:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6752c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486219136:0@lo:501: 10000000:01000000:0.0:1787855703.869337:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787855703.869408:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c0031400/0x516929ca3366d49a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d4a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855703.869418:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c0031400/0x516929ca3366d49a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d4a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787855703.869439:0:6982:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787855703.869607:0:6982:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 194721831003ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787855703.873652:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486219264:0@lo:400: 00000100:00100000:2.0:1787855703.873726:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855703.873800:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787855703.873808:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486219392:0@lo:400: 00000100:00100000:2.0:1787855703.873838:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855703.873899:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486219264 00000100:00100000:2.0:1787855703.873907:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486219264 00000100:00100000:2.0:1787855703.873948:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486219392 00000100:00100000:2.0:1787855703.873951:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486219392 00000100:00100000:2.0:1787855703.874265:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787855703.874273:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7420f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486219264:12345-0@lo:400: 00000100:00100000:2.0:1787855703.874331:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7420f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486219264:12345-0@lo:400: Request processed in 58us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855703.874338:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787855703.874429:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855703.874477:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787855703.874484:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486219392:12345-0@lo:400: 00000100:00100000:2.0:1787855703.874517:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486219392:12345-0@lo:400: Request processed in 34us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855703.874524:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787855703.874562:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73cb7a7840 x1874702486219392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855703.874575:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486219392:0@lo:400: 00010000:00080000:2.0:1787855703.874586:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73cb7a70c0 x1874702486219264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855703.874593:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486219264:0@lo:400: 00000004:00080000:3.0:1787855703.969655:0:6983:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787855703.969693:0:6983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6983:1874702486219648:0@lo:7: 00000100:00100000:3.0:1787855703.969766:0:6983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855703.969830:0:6983:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d0f37900 going to sleep for 11 seconds 00000100:00100000:3.0:1787855703.969858:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486219648 00000100:00100000:3.0:1787855703.969865:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486219648 00000100:00100000:3.0:1787855703.969918:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787855703.969927:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6983:x1874702486219648:12345-0@lo:7: 00000100:00080000:1.0:1787855703.973929:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787855703.975361:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486219520:0@lo:13: 00000100:00100000:2.0:1787855703.975440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855703.975532:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486219520 00000100:00100000:2.0:1787855703.975541:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486219520 00000100:00100000:2.0:1787855703.975583:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787855703.975593:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7422580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874702486219520:12345-0@lo:13: 00002000:00000024:2.0:1787855703.975628:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787855703.975677:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7422580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874702486219520:12345-0@lo:13: Request processed in 86us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855703.975684:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787855703.975720:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73cb7a43c0 x1874702486219520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855703.975740:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486219520:0@lo:13: 00002000:00080000:3.0:1787855703.982830:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787855703.982839:0:6681:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787855703.982943:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6983:x1874702486219648:12345-0@lo:7: Request processed in 13012us (13172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855703.982955:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787855703.983017:0:6983:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73cb7a6d00 x1874702486219648/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787855719 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855703.983034:0:6983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6983:1874702486219648:0@lo:7: 00000004:00080000:3.0:1787855703.983049:0:6983:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787855703.983096:0:6983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6983:1874702486219776:0@lo:5: 00000100:00100000:3.0:1787855703.983133:0:6983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855703.983188:0:6983:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d0f37900 going to sleep for 11 seconds 00000100:00100000:3.0:1787855703.983209:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486219776 00000100:00100000:3.0:1787855703.983215:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486219776 00000100:00100000:3.0:1787855703.983268:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787855703.983280:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6983:x1874702486219776:12345-0@lo:5: 00002000:00080000:3.0:1787855703.983309:0:6680:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787855703.983313:0:6680:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787855703.983529:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6983:x1874702486219776:12345-0@lo:5: Request processed in 251us (394us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787855703.983537:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787855703.983565:0:6983:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73cb7a6d00 x1874702486219776/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787855719 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855703.983575:0:6983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6983:1874702486219776:0@lo:5: 00000004:00080000:3.0:1787855703.983583:0:6983:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787855703.983606:0:6983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a4b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6983:1874702486219904:0@lo:700: 00000100:00100000:3.0:1787855703.983630:0:6983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855703.983647:0:6983:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d0f37900 going to sleep for 11 seconds 00000100:00100000:3.0:1787855703.983663:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486219904 00000100:00100000:3.0:1787855703.983667:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486219904 00000100:00100000:3.0:1787855703.983691:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787855703.983698:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6983:x1874702486219904:12345-0@lo:700: 00000100:00100000:3.0:1787855703.983723:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6687:1874702486220032:0@lo:700: 00000100:00100000:3.0:1787855703.983751:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855703.983767:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d0f376c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787855703.983817:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486220032 00000100:00100000:3.0:1787855703.983821:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486220032 00000100:00100000:3.0:1787855703.983846:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787855703.983859:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6687:x1874702486220032:12345-0@lo:700: 00000004:00080000:1.0:1787855704.009620:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:2.0:1787855704.084847:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787855704.090566:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6687:x1874702486220032:12345-0@lo:700: Request processed in 106699us (106805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855704.090587:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787855704.090760:0:6687:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73cb7a43c0 x1874702486220032/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787855719 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855704.090814:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6687:1874702486220032:0@lo:700: 40000000:02000000:3.0:1787855704.090828:0:6687:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:2.0:1787855704.201937:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787855704.201961:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1787855704.202236:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6983:x1874702486219904:12345-0@lo:700: Request processed in 218529us (218595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855704.202260:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787855704.202421:0:6983:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73cb7a4b40 x1874702486219904/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787855719 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855704.202433:0:6983:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787855704.202450:0:6983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a4b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6983:1874702486219904:0@lo:700: 00000004:02000040:2.0:1787855704.250852:0:6983:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1787855704.256095:0:6983:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7421a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6983:1874702486220160:0@lo:5: 00000100:00100000:2.0:1787855704.256167:0:6983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855704.256231:0:6983:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50a3480 going to sleep for 11 seconds 00000100:00100000:0.0:1787855704.256321:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486220160 00000100:00100000:0.0:1787855704.256332:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486220160 00000100:00100000:0.0:1787855704.256386:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787855704.256396:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6983:x1874702486220160:12345-0@lo:5: 00002000:00080000:0.0:1787855704.262875:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787855704.262899:0:6681:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1787855704.266186:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6983:x1874702486220160:12345-0@lo:5: Request processed in 9785us (10012us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787855704.266199:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787855704.266301:0:6983:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73e7421a40 x1874702486220160/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787855720 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855704.266320:0:6983:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7421a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6983:1874702486220160:0@lo:5: 00000004:00080000:2.0:1787855704.266336:0:6983:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1787855704.829578:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787855704.883979:0:7046:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787855705.853108:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855706.880608:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855707.903393:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855708.924473:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855709.309262:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486220672:0@lo:400: 00000100:00100000:3.0:1787855709.311009:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855709.311083:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787855709.311095:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486220288:0@lo:400: 00000100:00100000:3.0:1787855709.311133:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855709.311186:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486220416:0@lo:400: 00000100:00100000:3.0:1787855709.311248:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855709.311271:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787855709.311277:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486220544:0@lo:400: 00000100:00100000:3.0:1787855709.311299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855709.311723:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486220672 00000100:00100000:3.0:1787855709.311731:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486220672 00000100:00100000:3.0:1787855709.315384:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486220288 00000100:00100000:3.0:1787855709.315399:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486220288 00000100:00100000:3.0:1787855709.315449:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787855709.315459:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c446b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:3306:x1874702486220288:12345-0@lo:400: 00000100:00100000:3.0:1787855709.315542:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c446b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:3306:x1874702486220288:12345-0@lo:400: Request processed in 85us (4407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855709.315559:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787855709.315609:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486220416 00000100:00100000:3.0:1787855709.315614:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486220416 00000100:00100000:3.0:1787855709.315641:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486220544 00000100:00100000:3.0:1787855709.315645:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486220544 00000100:00080000:0.0:1787855709.315743:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855709.315798:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7421680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486220800:0@lo:13: 00000100:00100000:0.0:1787855709.315836:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787855709.315873:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787855709.316870:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787855709.316888:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486220416:12345-0@lo:400: 00000100:00100000:0.0:1787855709.316957:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486220416:12345-0@lo:400: Request processed in 76us (5708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855709.316964:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787855709.317029:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486220288:0@lo:400: 00000100:00100000:0.0:1787855709.317078:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787855709.317086:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874702486220672:12345-0@lo:400: 00000100:00100000:0.0:1787855709.317121:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874702486220672:12345-0@lo:400: Request processed in 37us (6120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855709.317134:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787855709.317181:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73cb7a5a40 x1874702486220672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855709.317195:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486220672:0@lo:400: 00000100:00100000:3.0:1787855709.320362:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787855709.320375:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486220544:12345-0@lo:400: 00000100:00100000:3.0:1787855709.320450:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486220544:12345-0@lo:400: Request processed in 79us (9150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855709.320457:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787855709.320720:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73cb7a5e00 x1874702486220544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855709.320735:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486220544:0@lo:400: 00010000:00080000:3.0:1787855709.320747:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73cb7a5680 x1874702486220416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855709.320755:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486220416:0@lo:400: 00000100:00100000:0.0:1787855709.327454:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486220800 00000100:00100000:0.0:1787855709.327468:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486220800 00000100:00100000:0.0:1787855709.327526:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787855709.327535:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874702486220800:12345-0@lo:13: 00002000:00000024:0.0:1787855709.327574:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855709.327655:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874702486220800:12345-0@lo:13: Request processed in 121us (11817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855709.327662:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787855709.327708:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73e7421680 x1874702486220800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855709.327728:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7421680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486220800:0@lo:13: 00000001:00080000:2.0:1787855709.379256:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787855709.949530:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855710.973610:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855711.996114:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855713.021213:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855714.045392:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855714.429233:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486221056:0@lo:400: 00000100:00100000:2.0:1787855714.429300:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855714.429355:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787855714.429371:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7422940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486220928:0@lo:400: 00000100:00100000:2.0:1787855714.429400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855714.429430:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486221184:0@lo:400: 00000100:00100000:2.0:1787855714.429452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855714.429470:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787855714.429475:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7423c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486221312:0@lo:400: 00000100:00100000:2.0:1787855714.429497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855714.429527:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486221056 00000100:00100000:2.0:1787855714.429533:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486221056 00000100:00100000:2.0:1787855714.429571:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486221184 00000100:00100000:2.0:1787855714.429574:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486221184 00000100:00100000:2.0:1787855714.429600:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787855714.429607:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7422d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486221056:12345-0@lo:400: 00000100:00100000:2.0:1787855714.429668:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7422d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486221056:12345-0@lo:400: Request processed in 60us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855714.429675:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787855714.429691:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787855714.429698:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7420b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486221184:12345-0@lo:400: 00000100:00100000:2.0:1787855714.429726:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7420b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486221184:12345-0@lo:400: Request processed in 29us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855714.429733:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787855714.429748:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486220928 00000100:00100000:2.0:1787855714.429751:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486220928 00000100:00100000:2.0:1787855714.429772:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787855714.429805:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c446a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:3305:x1874702486220928:12345-0@lo:400: 00000100:00100000:2.0:1787855714.429833:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c446a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:3305:x1874702486220928:12345-0@lo:400: Request processed in 29us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855714.429849:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787855714.429878:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486221312 00000100:00100000:2.0:1787855714.429881:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486221312 00000100:00100000:2.0:1787855714.429907:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787855714.429913:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7421e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486221312:12345-0@lo:400: 00000100:00100000:2.0:1787855714.429941:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7421e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486221312:12345-0@lo:400: Request processed in 28us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855714.429947:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787855714.429965:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787855714.429970:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787855714.430000:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73e7423c00 x1874702486221312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855714.430010:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787855714.430025:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7423c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486221312:0@lo:400: 00010000:00080000:2.0:1787855714.430037:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73e74203c0 x1874702486221184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855714.430045:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486221184:0@lo:400: 00000100:00100000:2.0:1787855714.430079:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7422940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486220928:0@lo:400: 00010000:00080000:2.0:1787855714.430088:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73e74212c0 x1874702486221056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855714.430096:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486221056:0@lo:400: 00000100:00100000:2.0:1787855714.433789:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486221440:0@lo:13: 00000100:00100000:2.0:1787855714.433854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855714.433919:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486221440 00000100:00100000:2.0:1787855714.433933:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486221440 00000100:00100000:2.0:1787855714.433978:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787855714.433986:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7422940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486221440:12345-0@lo:13: 00002000:00000024:2.0:1787855714.434020:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787855714.434073:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7422940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486221440:12345-0@lo:13: Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855714.434080:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787855714.434119:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73e74212c0 x1874702486221440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855714.434137:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486221440:0@lo:13: 00010000:00010000:2.0:1787855715.068282:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787855715.675682:0:7610:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787855715.675686:0:7610:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787855715.675844:0:7610:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a73e762a800 00000020:01000004:0.0:1787855715.675861:0:7610:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787855715.675873:0:7610:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787855715.675886:0:7610:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a73c50e4d70) 00000020:00000080:0.0:1787855715.675900:0:7610:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787855715.732494:0:7610:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787855715.733029:0:7610:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787855715.766879:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787855715.782853:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787855715.782905:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787855715.791485:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787855715.791717:0:7610:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787855715.793958:0:7610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787855715.793973:0:7610:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787855715.793985:0:7610:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x516929ca3366d4af 00000020:01000004:2.0:1787855715.793992:0:7610:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787855715.794015:0:7610:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.138@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787855715.794020:0:7610:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787855715.794025:0:7610:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787855715.794059:0:7610:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787855715.794063:0:7610:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787855715.849486:0:7610:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787855715.849524:0:7610:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.138@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787855715.849529:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787855715.849530:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787855715.849532:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787855715.849609:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787855715.849610:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787855715.849612:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787855715.849613:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787855715.849614:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787855715.849616:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787855715.849617:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787855715.849619:0:7610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787855715.849622:0:7610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787855715.849624:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787855715.849625:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787855715.849626:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787855715.849627:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787855715.849627:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787855715.849628:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787855715.849629:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787855715.849630:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787855715.849631:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787855715.849632:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787855715.849632:0:7610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787855715.849660:0:7610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787855715.849678:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb675680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486221568:0@lo:253: 00000100:00100000:0.0:1787855715.850702:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855715.850842:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c3307f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787855715.856707:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486221568 00000100:00100000:2.0:1787855715.856744:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486221568 00000100:00100000:2.0:1787855715.856882:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787855715.856892:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:7610:x1874702486221568:12345-0@lo:253: 20000000:01000000:2.0:1787855715.856939:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787855715.856943:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787855715.856948:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787855715.856951:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787855715.866685:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787855715.866953:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787855715.867081:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787855715.867126:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787855715.867265:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787855715.867305:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787855715.867357:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787855715.867724:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787855715.867744:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.138@tcp 20000000:01000000:1.0:1787855715.867746:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:1.0:1787855715.867820:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787855715.867830:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787855715.867898:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787855715.867913:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:1.0:1787855715.867948:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787855715.867956:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787855715.868869:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787855715.868937:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787855715.869706:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787855715.869728:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.138@tcp 20000000:01000000:1.0:1787855715.869731:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.138@tcp (null) (null) (null) 00000040:00080000:1.0:1787855715.869764:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787855715.869772:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787855715.869843:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787855715.869851:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.138@tcp (null) (null) 00000040:00080000:1.0:1787855715.869881:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787855715.869890:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787855715.869936:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787855715.869973:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787855715.869989:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787855715.869991:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787855715.869995:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787855715.870008:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787855715.870011:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787855715.870060:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787855715.870063:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787855715.872893:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787855715.872992:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787855715.873057:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787855715.874209:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787855715.874256:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787855715.874325:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787855715.874338:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787855715.874342:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787855715.881852:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787855715.882871:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787855715.882919:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787855715.883279:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787855715.883295:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787855715.883304:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787855715.886523:0:7614:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787855715.886639:0:7614:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787855715.886676:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787855715.887343:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787855715.887393:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787855715.887485:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1787855715.887499:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787855715.887502:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787855715.890339:0:7615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787855715.890425:0:7615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787855715.890479:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787855715.891540:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1787855715.891587:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1787855715.891624:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1787855715.891643:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1787855715.891645:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1787855715.891654:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787855715.891673:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d4b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.891701:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a7402173400/0x516929ca3366d407 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d400 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.891709:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a7402172e00/0x516929ca3366d431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d42a expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.891715:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a7402046e00/0x516929ca3366d45b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d454 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.891721:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a7402047200/0x516929ca3366d477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d470 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.891727:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c0031000/0x516929ca3366d4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d49a expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.891734:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d4b6 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.891770:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c0031000/0x516929ca3366d4a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d49a expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.891815:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a73c0031000/0x516929ca3366d4a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d49a expref: 16 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855715.891830:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb677840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1874702486221696:0@lo:104: 00000100:00100000:0.0:1787855715.891897:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787855715.891948:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a7402047200/0x516929ca3366d477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d470 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.891956:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a7402047200/0x516929ca3366d477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d470 expref: 16 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855715.892129:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787855715.892152:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486221696 00000100:00100000:2.0:1787855715.892158:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486221696 00000100:00100000:2.0:1787855715.892199:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787855715.892208:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73dc5f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:5826:x1874702486221696:12345-0@lo:104: 00010000:00010000:2.0:1787855715.892220:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73c0031400/0x516929ca3366d49a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d4a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855715.892265:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787855715.892271:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73dc5f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:5826:x1874702486221696:12345-0@lo:104: Request processed in 65us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855715.892278:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787855715.892333:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855715.892339:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c0031400/0x516929ca3366d49a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d4a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855715.892345:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c0031400 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:2.0:1787855715.892349:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c0031400/0x516929ca3366d49a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d4a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855715.892367:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c0031400/0x516929ca3366d49a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d4a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787855715.892374:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c0031400/0x516929ca3366d49a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d4a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855715.892379:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787855715.892406:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c0031400/0x516929ca3366d49a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d4a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855715.892412:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787855715.892427:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c0031400/0x516929ca3366d49a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d4a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855715.892433:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c0031400/0x516929ca3366d49a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d4a1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855715.892446:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855715.892448:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855715.892450:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855715.892470:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486221952:0@lo:103: 00000100:00100000:2.0:1787855715.892496:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855715.892536:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486221952 00000100:00100000:2.0:1787855715.892541:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486221952 00010000:00010000:2.0:1787855715.892557:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c0031000/0x516929ca3366d4a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d49a expref: 17 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855715.892577:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787855715.892584:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:3305:x1874702486221952:12345-0@lo:103: 00010000:00010000:2.0:1787855715.892600:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855715.892606:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c0031000/0x516929ca3366d4a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d49a expref: 17 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855715.892808:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6770c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1874702486221824:0@lo:104: 00000100:00100000:0.0:1787855715.892833:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855715.892894:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486221824 00000100:00100000:1.0:1787855715.892898:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486221824 00000100:00100000:1.0:1787855715.892923:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787855715.892930:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb674f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:5826:x1874702486221824:12345-0@lo:104: 00010000:00010000:1.0:1787855715.892938:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a7402046400/0x516929ca3366d470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d477 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.893053:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787855715.893060:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb674f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:5826:x1874702486221824:12345-0@lo:104: Request processed in 131us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855715.893067:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1787855715.893085:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787855715.893089:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402046400/0x516929ca3366d470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d477 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.893095:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402046400 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:1.0:1787855715.893098:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402046400/0x516929ca3366d470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d477 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.893105:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402046400/0x516929ca3366d470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d477 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787855715.893112:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402046400/0x516929ca3366d470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d477 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787855715.893118:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787855715.893203:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402046400/0x516929ca3366d470 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d477 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.893211:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787855715.893226:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402046400/0x516929ca3366d470 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d477 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.893233:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402046400/0x516929ca3366d470 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d477 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.893245:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855715.893246:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855715.893248:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855715.893263:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc256580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486222080:0@lo:103: 00000100:00100000:1.0:1787855715.893290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855715.893323:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787855715.893331:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787855715.893437:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486222080 00000100:00100000:1.0:1787855715.893441:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486222080 00010000:00010000:1.0:1787855715.893455:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a7402047200/0x516929ca3366d477 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d470 expref: 18 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855715.893471:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787855715.893480:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787855715.893486:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc2543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:3306:x1874702486222080:12345-0@lo:103: 00010000:00010000:1.0:1787855715.893493:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855715.893497:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a7402047200/0x516929ca3366d477 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d470 expref: 18 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855715.893727:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c0031000/0x516929ca3366d4a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d49a expref: 18 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855715.893743:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855715.893802:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:3305:x1874702486221952:12345-0@lo:103: Request processed in 1218us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855715.893809:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787855715.893915:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486221952:0@lo:103: 00010000:00010000:0.0:1787855715.898654:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a7402046e00/0x516929ca3366d45b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d454 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.898675:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a7402046e00/0x516929ca3366d45b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d454 expref: 17 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855715.898692:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6743c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1874702486222208:0@lo:104: 00000100:00100000:0.0:1787855715.898769:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787855715.898849:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a7402172e00/0x516929ca3366d431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d42a expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.898857:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a7402172e00/0x516929ca3366d431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d42a expref: 17 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855715.898864:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb677c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1874702486222336:0@lo:104: 00000100:00100000:3.0:1787855715.898868:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486222208 00000100:00100000:3.0:1787855715.898875:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486222208 00000100:00100000:0.0:1787855715.898882:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855715.898904:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486222336 00000100:00100000:0.0:1787855715.898907:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486222336 00000100:00100000:3.0:1787855715.898916:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787855715.898924:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb675a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+4:5826:x1874702486222208:12345-0@lo:104: 00010000:00010000:3.0:1787855715.898943:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a7402173800/0x516929ca3366d454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d45b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855715.898990:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1787855715.898990:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a7402047200/0x516929ca3366d477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d470 expref: 17 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855715.898995:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb675a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+4:5826:x1874702486222208:12345-0@lo:104: Request processed in 72us (227us total) trans 0 rc 0/0 00010000:00010000:1.0:1787855715.899020:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855715.899065:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc2543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:3306:x1874702486222080:12345-0@lo:103: Request processed in 5579us (5773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855715.899073:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787855715.899130:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc256580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486222080:0@lo:103: 00010000:00010000:1.0:1787855715.901978:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a7402173400/0x516929ca3366d407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d400 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.901997:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a7402173400/0x516929ca3366d407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d400 expref: 16 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855715.902013:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc256580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1874702486222464:0@lo:104: 00000100:00100000:1.0:1787855715.902085:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855715.902110:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c33070c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787855715.902136:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c0031000/0x516929ca3366d4a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d49a expref: 16 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855715.902153:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb677840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1874702486221696:0@lo:104: 00010000:00010000:1.0:1787855715.902165:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402047200/0x516929ca3366d477 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d470 expref: 15 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855715.902174:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6770c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1874702486221824:0@lo:104: 00000100:00100000:1.0:1787855715.902183:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6743c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1874702486222208:0@lo:104: 00000100:00100000:0.0:1787855715.902690:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1787855715.902701:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1787855715.902827:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486222464 00000100:00100000:0.0:1787855715.902834:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486222464 00000100:00100000:0.0:1787855715.902919:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787855715.902928:0:7617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb676940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+5:5826:x1874702486222336:12345-0@lo:104: 00010000:00010000:0.0:1787855715.902943:0:7617:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73c0031800/0x516929ca3366d42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d431 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903185:0:7617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787855715.903192:0:7617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb676940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+5:5826:x1874702486222336:12345-0@lo:104: Request processed in 265us (4307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855715.903198:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787855715.903216:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787855715.903222:0:7617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc255680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+4:5826:x1874702486222464:12345-0@lo:104: 00010000:00010000:0.0:1787855715.903229:0:7617:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a7402172200/0x516929ca3366d400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d407 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903255:0:7617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787855715.903260:0:7617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc255680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+4:5826:x1874702486222464:12345-0@lo:104: Request processed in 39us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855715.903264:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787855715.903300:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb677c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1874702486222336:0@lo:104: 00000100:00100000:0.0:1787855715.903308:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc256580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5826:1874702486222464:0@lo:104: 00010000:00010000:0.0:1787855715.903345:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d4b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903370:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787855715.903377:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402173800/0x516929ca3366d454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d45b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903384:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402173800 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787855715.903388:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402173800/0x516929ca3366d454 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d45b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903395:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402173800/0x516929ca3366d454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d45b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855715.903409:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402173800/0x516929ca3366d454 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d45b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855715.903415:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787855715.903447:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402173800/0x516929ca3366d454 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d45b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903453:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787855715.903469:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402173800/0x516929ca3366d454 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d45b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903476:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402173800/0x516929ca3366d454 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d45b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903488:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787855715.903492:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c0031800/0x516929ca3366d42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d431 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903498:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c0031800 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787855715.903500:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c0031800/0x516929ca3366d42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d431 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903507:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c0031800/0x516929ca3366d42a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d431 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855715.903513:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c0031800/0x516929ca3366d42a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d431 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855715.903518:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787855715.903538:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c0031800/0x516929ca3366d42a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d431 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903543:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787855715.903571:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c0031800/0x516929ca3366d42a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d431 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903578:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c0031800/0x516929ca3366d42a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d431 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903589:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855715.903591:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402172200/0x516929ca3366d400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d407 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903596:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402172200 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787855715.903599:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402172200/0x516929ca3366d400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d407 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903605:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402172200/0x516929ca3366d400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d407 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855715.903611:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402172200/0x516929ca3366d400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d407 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855715.903616:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787855715.903627:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402172200/0x516929ca3366d400 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d407 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903632:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787855715.903638:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402172200/0x516929ca3366d400 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d407 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903653:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402172200/0x516929ca3366d400 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d407 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903665:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855715.903667:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855715.903668:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855715.903690:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb677c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486222592:0@lo:103: 00000100:00100000:0.0:1787855715.903723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855715.903806:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486222592 00000100:00100000:0.0:1787855715.903810:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486222592 00010000:00010000:0.0:1787855715.903828:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a7402046e00/0x516929ca3366d45b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d454 expref: 15 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855715.903847:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787855715.903853:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb677840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:3307:x1874702486222592:12345-0@lo:103: 00010000:00010000:0.0:1787855715.903862:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855715.903867:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a7402046e00/0x516929ca3366d45b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d454 expref: 15 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903877:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a7402046e00/0x516929ca3366d45b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d454 expref: 15 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903889:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402046e00/0x516929ca3366d45b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d454 expref: 15 pid: 5828 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.903901:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855715.903925:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb677840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:3307:x1874702486222592:12345-0@lo:103: Request processed in 73us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855715.903939:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787855715.903957:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486222720:0@lo:103: 00000100:00100000:0.0:1787855715.905371:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855715.905461:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787855715.905470:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486222848:0@lo:103: 00000100:00100000:3.0:1787855715.905472:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1787855715.905505:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855715.905513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855715.907920:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb677c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486222592:0@lo:103: 00000100:00100000:2.0:1787855715.910152:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486222720 00000100:00100000:2.0:1787855715.910168:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486222720 00010000:00010000:3.0:1787855715.910310:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a7402172e00/0x516929ca3366d431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d42a expref: 14 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855715.911108:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486222848 00000100:00100000:1.0:1787855715.911115:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486222848 00010000:00010000:1.0:1787855715.911172:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a7402173400/0x516929ca3366d407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d400 expref: 15 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855715.911240:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787855715.911250:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb675e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:3304:x1874702486222720:12345-0@lo:103: 00010000:00010000:1.0:1787855715.911263:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855715.911268:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a7402172e00/0x516929ca3366d431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d42a expref: 15 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.911281:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a7402172e00/0x516929ca3366d431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d42a expref: 15 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.911298:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402172e00/0x516929ca3366d431 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d42a expref: 15 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.911312:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855715.911380:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb675e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:3304:x1874702486222720:12345-0@lo:103: Request processed in 131us (6014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855715.911386:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787855715.911402:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787855715.911407:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3357c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:3304:x1874702486222848:12345-0@lo:103: 00010000:00010000:1.0:1787855715.911413:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855715.911417:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a7402173400/0x516929ca3366d407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d400 expref: 13 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.911425:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a7402173400/0x516929ca3366d407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d400 expref: 13 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.911435:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402173400/0x516929ca3366d407 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d400 expref: 13 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.911455:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d4b6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.911464:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d4b6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.911479:0:7616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d4b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.911486:0:7616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d4b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.911493:0:7616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d4b6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.911500:0:7616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d4b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.911507:0:7616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143c00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787855715.911511:0:7616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d4b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.911519:0:7616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d4b6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.911533:0:7616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d4b6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.911542:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855715.911561:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3357c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:3304:x1874702486222848:12345-0@lo:103: Request processed in 154us (6048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855715.911573:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787855715.913268:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d4b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.913284:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d4b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855715.913291:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d4b6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787855715.913309:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787855715.913454:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486222848:0@lo:103: 00000100:00100000:2.0:1787855715.913465:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486222720:0@lo:103: 00000100:00100000:3.0:1787855715.965011:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:7610:x1874702486221568:12345-0@lo:253: Request processed in 108111us (114304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855715.965027:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787855715.965115:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb675680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486221568:0@lo:253: 10000000:01000000:3.0:1787855715.965132:0:7610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787855715.965586:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787855715.965588:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787855715.965589:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787855715.965590:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787855715.965591:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787855715.965593:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787855715.965595:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787855715.965596:0:7610:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787855715.965598:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787855715.965599:0:7610:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787855715.965627:0:7610:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a73e762a800 from lustre-OST0001 10000000:01000000:3.0:1787855715.965654:0:7610:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787855715.965657:0:7610:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787855715.965666:0:7610:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a73c44919d0 local copy 10000000:01000000:3.0:1787855715.965670:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787855715.965706:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402172c00/0x516929ca3366d4bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855715.965732:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.138@tcp lock: ffff9a7402172c00/0x516929ca3366d4bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855715.965742:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a7402172c00/0x516929ca3366d4bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855715.965763:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486222976:0@lo:101: 00000100:00100000:3.0:1787855715.965852:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855715.965892:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d06620c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855715.966265:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486222976 00000100:00100000:2.0:1787855715.966274:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486222976 00000100:00100000:2.0:1787855715.966314:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787855715.966323:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:7610:x1874702486222976:12345-0@lo:101: 00010000:00010000:2.0:1787855715.966335:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855715.966349:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402047600/0x516929ca3366d4c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d4bd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855715.966372:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402047600/0x516929ca3366d4c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d4bd expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855715.966382:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402047600/0x516929ca3366d4c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d4bd expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855715.966403:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402047600, rc 0) 00000100:00100000:2.0:1787855715.966454:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:7610:x1874702486222976:12345-0@lo:101: Request processed in 133us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855715.966462:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787855715.966621:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486222976:0@lo:101: 00010000:00010000:3.0:1787855715.966636:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a7402172c00/0x516929ca3366d4bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x516929ca3366d4c4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855715.966644:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a7402172c00/0x516929ca3366d4bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x516929ca3366d4c4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855715.966759:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486223104:0@lo:501: 00000100:00100000:3.0:1787855715.966822:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855715.966889:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d06620c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855715.968730:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486223104 00000100:00100000:2.0:1787855715.968745:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486223104 00000100:00100000:2.0:1787855715.968864:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787855715.968876:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:7610:x1874702486223104:12345-0@lo:501: 00000100:00100000:2.0:1787855715.969546:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:7610:x1874702486223104:12345-0@lo:501: Request processed in 670us (2721us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787855715.969557:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787855715.969636:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486223104:0@lo:501: 10000000:01000000:3.0:1787855715.969656:0:7610:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787855715.969689:0:7610:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787855715.969697:0:7610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402172c00/0x516929ca3366d4bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x516929ca3366d4c4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855715.969706:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402172c00/0x516929ca3366d4bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x516929ca3366d4c4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855715.969721:0:7610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff9a7402172c00/0x516929ca3366d4bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x516929ca3366d4c4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855715.971278:0:7610:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787855715.971320:0:7610:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a73e762a800 10000000:01000000:3.0:1787855715.971329:0:7610:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787855715.971335:0:7610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787855715.971338:0:7610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787855715.971342:0:7610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787855715.971345:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787855715.971383:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402173400/0x516929ca3366d4cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855715.971394:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a7402173400/0x516929ca3366d4cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855715.971403:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a7402173400/0x516929ca3366d4cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855715.971424:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486223232:0@lo:101: 00000100:00100000:3.0:1787855715.971478:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855715.971530:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d0662c00 going to sleep for 11 seconds 00010000:00010000:0.0:1787855715.971722:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855715.971730:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402172c00/0x516929ca3366d4bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x516929ca3366d4c4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.971737:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402172c00 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787855715.971742:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402172c00/0x516929ca3366d4bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x516929ca3366d4c4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.971827:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402172c00/0x516929ca3366d4bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x516929ca3366d4c4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855715.971835:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402172c00/0x516929ca3366d4bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x516929ca3366d4c4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855715.971840:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787855715.971861:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402172c00/0x516929ca3366d4bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x516929ca3366d4c4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.971867:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787855715.971894:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402172c00/0x516929ca3366d4bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x516929ca3366d4c4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.971901:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402172c00/0x516929ca3366d4bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x516929ca3366d4c4 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.971928:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855715.971930:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855715.971932:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855715.971990:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787855715.972004:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486223360:0@lo:103: 00000100:00100000:3.0:1787855715.972046:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855715.972396:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486223360 00000100:00100000:0.0:1787855715.972403:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486223360 00000100:00100000:0.0:1787855715.972451:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787855715.972459:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:3307:x1874702486223360:12345-0@lo:103: 00010000:00010000:0.0:1787855715.972470:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855715.972482:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402047600/0x516929ca3366d4c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x516929ca3366d4bd expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.972498:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855715.972630:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486223232 00000100:00100000:2.0:1787855715.972634:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486223232 00000100:00100000:0.0:1787855715.972648:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:3307:x1874702486223360:12345-0@lo:103: Request processed in 190us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855715.972656:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787855715.972668:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787855715.972675:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+11:7610:x1874702486223232:12345-0@lo:101: 00010000:00010000:2.0:1787855715.972687:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855715.972700:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402047800/0x516929ca3366d4d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d4cb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855715.972719:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486223360:0@lo:103: 00010000:00010000:2.0:1787855715.972719:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402047800/0x516929ca3366d4d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d4cb expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855715.972730:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402047800/0x516929ca3366d4d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d4cb expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855715.972736:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402047800, rc 0) 00000100:00100000:2.0:1787855715.972798:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:7610:x1874702486223232:12345-0@lo:101: Request processed in 123us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855715.972814:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787855715.972954:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486223232:0@lo:101: 00010000:00010000:0.0:1787855715.972968:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a7402173400/0x516929ca3366d4cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d4d2 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855715.972977:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a7402173400/0x516929ca3366d4cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d4d2 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855715.973092:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3357840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486223488:0@lo:501: 00000100:00100000:0.0:1787855715.973121:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855715.973138:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c3307b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787855715.973189:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486223488 00000100:00100000:2.0:1787855715.973194:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486223488 00000100:00100000:2.0:1787855715.973224:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787855715.973232:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c446b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:7610:x1874702486223488:12345-0@lo:501: 00000100:00100000:2.0:1787855715.973451:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c446b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:7610:x1874702486223488:12345-0@lo:501: Request processed in 220us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855715.973457:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787855715.973537:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3357840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486223488:0@lo:501: 00000100:00100000:0.0:1787855715.973573:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3357840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486223616:0@lo:503: 00000100:00100000:0.0:1787855715.973608:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855715.973630:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c3307b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787855715.973688:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486223616 00000100:00100000:1.0:1787855715.973692:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486223616 00000100:00100000:1.0:1787855715.973725:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787855715.973732:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c446a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:7610:x1874702486223616:12345-0@lo:503: 00000100:00100000:1.0:1787855715.973897:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c446a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:7610:x1874702486223616:12345-0@lo:503: Request processed in 165us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855715.973904:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787855715.973998:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3357840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486223616:0@lo:503: 00000040:00080000:0.0:1787855715.974264:0:7610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787855715.974323:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3357840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486223744:0@lo:502: 00000100:00100000:0.0:1787855715.974356:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855715.974374:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c3307b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787855715.974431:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486223744 00000100:00100000:2.0:1787855715.974435:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486223744 00000100:00100000:2.0:1787855715.974464:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787855715.974472:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:7610:x1874702486223744:12345-0@lo:502: 00000100:00100000:2.0:1787855715.974605:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:7610:x1874702486223744:12345-0@lo:502: Request processed in 134us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855715.974611:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787855715.974693:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3357840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486223744:0@lo:502: 00000040:00080000:0.0:1787855715.974961:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787855715.975008:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787855715.975055:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787855715.975102:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787855715.975139:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787855715.975173:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787855715.975196:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3357840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486223872:0@lo:502: 00000100:00100000:0.0:1787855715.975237:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855715.975257:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c3307b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787855715.975326:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486223872 00000100:00100000:1.0:1787855715.975331:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486223872 00000100:00100000:1.0:1787855715.975367:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787855715.975375:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:7610:x1874702486223872:12345-0@lo:502: 00000100:00100000:1.0:1787855715.975508:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:7610:x1874702486223872:12345-0@lo:502: Request processed in 134us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855715.975515:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787855715.975554:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3357840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486223872:0@lo:502: 00000040:00080000:1.0:1787855715.975630:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787855715.975646:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787855715.975978:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787855715.975986:0:7619:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787855715.975993:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855715.975996:0:7619:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787855715.976001:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787855715.976023:0:7619:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a72c2bd33a0) 00000020:00000080:1.0:1787855715.976057:0:7619:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787855715.976065:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787855715.976125:0:7619:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a73e762a800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787855715.976133:0:7619:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787855715.976141:0:7619:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x516929ca3366d4e0 00010000:00010000:1.0:1787855715.982097:0:7619:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787855715.985173:0:7619:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787855715.993279:0:7619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787855715.993580:0:7619:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787855715.999812:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787855716.000285:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787855716.004358:0:7619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787855716.004372:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787855716.004379:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855716.004381:0:7619:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787855716.004385:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787855716.004389:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855716.004391:0:7619:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787855716.004393:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787855716.004403:0:7619:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787855716.004462:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787855716.004466:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855716.004468:0:7619:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787855716.004472:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787855716.004644:0:7610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787855716.004672:0:7610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787855716.004698:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402173400/0x516929ca3366d4cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d4d2 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855716.004709:0:7610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a7402173400/0x516929ca3366d4cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d4d2 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855716.004718:0:7610:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73e762a800 from 1 10000000:01000000:2.0:1787855716.004721:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787855716.004756:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d4e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855716.004799:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d4e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855716.004812:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d4e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855716.004836:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7423c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486224000:0@lo:101: 00000100:00100000:2.0:1787855716.004904:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855716.004950:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787855716.005026:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486224000 00000100:00100000:3.0:1787855716.005053:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486224000 00000100:00100000:3.0:1787855716.005101:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787855716.005111:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:7610:x1874702486224000:12345-0@lo:101: 00010000:00010000:3.0:1787855716.005124:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855716.005135:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402172e00/0x516929ca3366d4ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d4e7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.005159:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402172e00/0x516929ca3366d4ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d4e7 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.005169:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402172e00/0x516929ca3366d4ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d4e7 expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.005177:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402172e00, rc 0) 00000100:00100000:3.0:1787855716.005217:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:7610:x1874702486224000:12345-0@lo:101: Request processed in 109us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855716.005224:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787855716.005271:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7423c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486224000:0@lo:101: 00010000:00010000:3.0:1787855716.005284:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d4e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d4ee expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.005293:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d4e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d4ee expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855716.005380:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486224128:0@lo:501: 00000100:00100000:3.0:1787855716.005402:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855716.005421:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d0662900 going to sleep for 11 seconds 00000100:00100000:3.0:1787855716.005435:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486224128 00000100:00100000:3.0:1787855716.005439:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486224128 00000100:00100000:3.0:1787855716.005465:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787855716.005471:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:7610:x1874702486224128:12345-0@lo:501: 00000100:00100000:3.0:1787855716.005666:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:7610:x1874702486224128:12345-0@lo:501: Request processed in 194us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855716.005673:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787855716.005707:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486224128:0@lo:501: 00000100:00100000:3.0:1787855716.005733:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486224256:0@lo:503: 00000100:00100000:3.0:1787855716.005801:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855716.005816:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d0662900 going to sleep for 11 seconds 00000100:00100000:3.0:1787855716.005829:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486224256 00000100:00100000:3.0:1787855716.005832:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486224256 00000100:00100000:3.0:1787855716.005853:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787855716.005859:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:7610:x1874702486224256:12345-0@lo:503: 00000100:00100000:3.0:1787855716.006140:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:7610:x1874702486224256:12345-0@lo:503: Request processed in 280us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855716.006147:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787855716.006183:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486224256:0@lo:503: 00000040:00080000:3.0:1787855716.006426:0:7610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787855716.006477:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486224384:0@lo:502: 00000100:00100000:3.0:1787855716.006510:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855716.006525:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c24a4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787855716.006539:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486224384 00000100:00100000:3.0:1787855716.006543:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486224384 00000100:00100000:3.0:1787855716.006566:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787855716.006573:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:7610:x1874702486224384:12345-0@lo:502: 00000100:00100000:3.0:1787855716.006699:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:7610:x1874702486224384:12345-0@lo:502: Request processed in 126us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855716.006711:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787855716.006749:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486224384:0@lo:502: 00000040:00080000:3.0:1787855716.007000:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787855716.007064:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787855716.007087:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486224512:0@lo:502: 00000100:00100000:3.0:1787855716.007122:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855716.007146:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c24a4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787855716.007159:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486224512 00000100:00100000:3.0:1787855716.007163:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486224512 00000100:00100000:3.0:1787855716.007188:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787855716.007196:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:7610:x1874702486224512:12345-0@lo:502: 00000100:00100000:3.0:1787855716.007327:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:7610:x1874702486224512:12345-0@lo:502: Request processed in 132us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855716.007334:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787855716.007376:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486224512:0@lo:502: 00000040:00080000:3.0:1787855716.007457:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787855716.007468:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787855716.020138:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787855716.020152:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787855716.020154:0:7622:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787855716.020161:0:7622:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a73e762a800 00000020:00000080:2.0:1787855716.020163:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787855716.020181:0:7622:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787855716.020184:0:7622:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787855716.020185:0:7622:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787855716.020188:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787855716.020376:0:7610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787855716.020400:0:7610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787855716.020427:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d4e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d4ee expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855716.020438:0:7610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d4e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d4ee expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855716.020476:0:7610:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787855716.020480:0:7610:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a73e762a800 10000000:01000000:0.0:1787855716.020483:0:7610:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a73e762a800 10000000:01000000:0.0:1787855716.020487:0:7610:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787855716.020492:0:7610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a73e762a800 from 1 10000000:01000000:0.0:1787855716.020495:0:7610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787855716.020529:0:7610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5142800/0x516929ca3366d4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855716.020537:0:7610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c5142800/0x516929ca3366d4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855716.020547:0:7610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c5142800/0x516929ca3366d4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855716.020567:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486224640:0@lo:101: 00000100:00100000:0.0:1787855716.020632:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855716.020677:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c3307c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787855716.021300:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486224640 00000100:00100000:2.0:1787855716.021308:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486224640 00000100:00100000:2.0:1787855716.021351:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787855716.021360:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:7610:x1874702486224640:12345-0@lo:101: 00010000:00010000:2.0:1787855716.021371:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855716.021383:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402046c00/0x516929ca3366d4fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d4f5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855716.021403:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402046c00/0x516929ca3366d4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d4f5 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855716.021424:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402046c00/0x516929ca3366d4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d4f5 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855716.021431:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402046c00, rc 0) 00000100:00100000:2.0:1787855716.021472:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:7610:x1874702486224640:12345-0@lo:101: Request processed in 113us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855716.021478:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787855716.021555:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486224640:0@lo:101: 00010000:00010000:0.0:1787855716.021569:0:7610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c5142800/0x516929ca3366d4f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d4fc expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855716.021577:0:7610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c5142800/0x516929ca3366d4f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d4fc expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855716.021661:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486224768:0@lo:501: 00000100:00100000:0.0:1787855716.021689:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855716.021711:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c3307c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787855716.025170:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486224768 00000100:00100000:2.0:1787855716.025186:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486224768 00000100:00100000:2.0:1787855716.025258:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787855716.025268:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:7610:x1874702486224768:12345-0@lo:501: 00000100:00100000:2.0:1787855716.025578:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:7610:x1874702486224768:12345-0@lo:501: Request processed in 311us (3887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855716.025586:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787855716.025708:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486224768:0@lo:501: 00000100:00100000:0.0:1787855716.025754:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486224896:0@lo:503: 00000100:00100000:0.0:1787855716.025826:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855716.025863:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c3307c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787855716.025942:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486224896 00000100:00100000:1.0:1787855716.025946:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486224896 00000100:00100000:1.0:1787855716.025975:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787855716.025982:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:7610:x1874702486224896:12345-0@lo:503: 00000100:00100000:1.0:1787855716.026141:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:7610:x1874702486224896:12345-0@lo:503: Request processed in 159us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855716.026147:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787855716.026211:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486224896:0@lo:503: 00000040:00080000:0.0:1787855716.026458:0:7610:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787855716.026513:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486225024:0@lo:502: 00000100:00100000:0.0:1787855716.026548:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855716.026580:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c3307c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787855716.026673:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486225024 00000100:00100000:3.0:1787855716.026678:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486225024 00000100:00100000:3.0:1787855716.026700:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787855716.026706:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:7610:x1874702486225024:12345-0@lo:502: 00000100:00100000:3.0:1787855716.026893:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:7610:x1874702486225024:12345-0@lo:502: Request processed in 186us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855716.026899:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787855716.026938:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33570c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486225024:0@lo:502: 00000040:00080000:3.0:1787855716.027207:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787855716.027257:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787855716.027294:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787855716.027340:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787855716.027373:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787855716.027422:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787855716.027460:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787855716.027497:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787855716.027547:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787855716.027587:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787855716.027623:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787855716.027674:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787855716.027712:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787855716.027760:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787855716.027838:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787855716.027877:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787855716.027914:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787855716.027962:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787855716.027998:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787855716.028033:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787855716.028099:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787855716.028136:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787855716.028172:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787855716.028220:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787855716.028258:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787855716.028295:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787855716.028359:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787855716.028397:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1787855716.028432:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787855716.028507:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1787855716.028548:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1787855716.028583:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1787855716.028629:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1787855716.028680:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1787855716.028718:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1787855716.028768:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1787855716.028837:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1787855716.028880:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486225152:0@lo:502: 00000100:00100000:3.0:1787855716.028947:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855716.028979:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c24a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787855716.029010:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486225152 00000100:00100000:3.0:1787855716.029016:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486225152 00000100:00100000:3.0:1787855716.029067:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787855716.029076:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:7610:x1874702486225152:12345-0@lo:502: 00000100:00100000:3.0:1787855716.029278:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:7610:x1874702486225152:12345-0@lo:502: Request processed in 203us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855716.029287:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787855716.029342:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486225152:0@lo:502: 00000040:00080000:3.0:1787855716.029405:0:7610:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787855716.029414:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1787855716.033999:0:7624:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787855716.034018:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a72c2bd4d70) 00000020:00000080:1.0:1787855716.034047:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1787855716.034117:0:7624:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a73e762a800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787855716.034121:0:7624:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a73e762a800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787855716.034123:0:7624:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a73e762a800 3 00010000:00080000:1.0:1787855716.034153:0:7624:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a72c1b22000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.138@tcp at head 00010000:00010000:1.0:1787855716.035677:0:7624:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787855716.035906:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787855716.035938:0:7624:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787855716.035949:0:7624:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x516929ca3366d50a 00000100:00080000:1.0:1787855716.035958:0:7624:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787855716.035963:0:7624:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a72c1b22000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1787855716.035997:0:7624:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73cc2552c0 x1874702486225280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787855716.036074:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874702486225280:0@lo:38: 00000100:00100000:3.0:1787855716.036141:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787855716.038854:0:7624:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787855716.039417:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486225280 00000100:00100000:3.0:1787855716.039427:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486225280 00000100:00100000:3.0:1787855716.039476:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787855716.039484:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1874702486225280:12345-0@lo:38: 00010000:00080000:3.0:1787855716.039512:0:5834:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:3.0:1787855716.039550:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x516929ca3366d511 00000004:00100000:3.0:1787855716.039566:0:5834:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787855716.039603:0:5834:0:(import.c:65:import_set_state_nolock()) ffff9a72c1322000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787855716.039686:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874702486225280:12345-0@lo:38: Request processed in 201us (3545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855716.039694:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787855716.039736:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73cc2552c0 x1874702486225280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787855726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855716.039746:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787855716.039755:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787855716.039762:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787855716.039766:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787855716.039768:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a72c1b22000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787855716.039794:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874702486225280:0@lo:38: 00000100:00100000:2.0:1787855716.040580:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7420780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486225536:0@lo:400: 00000100:00100000:2.0:1787855716.040626:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855716.040654:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787855716.040659:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7421680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486225664:0@lo:400: 00000100:00100000:2.0:1787855716.040680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855716.040702:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486225664 00000100:00100000:2.0:1787855716.040707:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486225536 00000100:00100000:0.0:1787855716.040708:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486225664 00000100:00100000:2.0:1787855716.040710:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486225536 00000100:00100000:3.0:1787855716.040753:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7421a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486225408:0@lo:400: 00000100:00100000:3.0:1787855716.040807:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855716.040827:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486225408 00000100:00100000:1.0:1787855716.040831:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486225408 00000100:00100000:1.0:1787855716.040862:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787855716.040869:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486225408:12345-0@lo:400: 00000100:00100000:1.0:1787855716.040917:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486225408:12345-0@lo:400: Request processed in 48us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855716.040923:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787855716.040978:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73e7421a40 x1874702486225408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855716.040990:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7421a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486225408:0@lo:400: 00000100:00100000:2.0:1787855716.041414:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787855716.041422:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486225536:12345-0@lo:400: 00000100:00100000:2.0:1787855716.041458:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486225536:12345-0@lo:400: Request processed in 37us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855716.041463:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787855716.041493:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787855716.041496:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787855716.041519:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73e7420780 x1874702486225536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855716.041529:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7420780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486225536:0@lo:400: 00000040:00080000:1.0:1787855716.041842:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1787855716.041984:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787855716.041993:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7423840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486225664:12345-0@lo:400: 00000100:00100000:0.0:1787855716.042047:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7423840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486225664:12345-0@lo:400: Request processed in 45us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855716.042054:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787855716.042089:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73e7421680 x1874702486225664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855716.042098:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7421680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486225664:0@lo:400: 00000020:01000000:3.0:1787855716.042156:0:7610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787855716.042183:0:7610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787855716.042204:0:7610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5142800/0x516929ca3366d4f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d4fc expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.042214:0:7610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c5142800/0x516929ca3366d4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d4fc expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787855716.042261:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787855716.042267:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787855716.042269:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787855716.042269:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787855716.042271:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787855716.042272:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787855716.042273:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787855716.042275:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787855716.042276:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787855716.042278:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787855716.042279:0:7610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787855716.042282:0:7610:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787855716.042285:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787855716.042286:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787855716.042287:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787855716.042288:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787855716.042289:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787855716.042290:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787855716.042294:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787855716.042296:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787855716.042297:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787855716.042298:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787855716.042299:0:7610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787855716.042317:0:7610:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787855716.042331:0:7610:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486225792:0@lo:253: 00000100:00100000:3.0:1787855716.042373:0:7610:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855716.042408:0:7610:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c24a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787855716.042455:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7626:1874702486225920:0@lo:901: 00000100:00100000:3.0:1787855716.042481:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855716.042503:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c24a4240 going to sleep for 11 seconds 00000100:00100000:1.0:1787855716.042545:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486225792 00000100:00100000:1.0:1787855716.042550:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486225792 00000100:00100000:2.0:1787855716.042554:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486225920 00000100:00100000:2.0:1787855716.042558:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486225920 00000100:00100000:1.0:1787855716.042580:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787855716.042586:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:7610:x1874702486225792:12345-0@lo:253: 00000100:00100000:2.0:1787855716.042588:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787855716.042593:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7626:x1874702486225920:12345-0@lo:901: 20000000:01000000:1.0:1787855716.042604:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787855716.042617:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787855716.042958:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7626:x1874702486225920:12345-0@lo:901: Request processed in 363us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855716.042965:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787855716.043022:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787855716.043054:0:7626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73cb7a5680 x1874702486225920/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787855732 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855716.043063:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7626:1874702486225920:0@lo:901: 20000000:01000000:1.0:1787855716.064703:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787855716.064758:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787855716.065523:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787855716.065529:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787855716.065686:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a7402172200/0x516929ca3366d518 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.065705:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a7402046600/0x516929ca3366d469 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d462 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.065714:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a7402172200/0x516929ca3366d518 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.065754:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a7402046600/0x516929ca3366d469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d462 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.065769:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a7402046600/0x516929ca3366d469 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d462 expref: 14 pid: 5826 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855716.065807:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874702486226048:0@lo:104: 00000100:00100000:3.0:1787855716.065871:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855716.065914:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c24a49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855716.066239:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486226048 00000100:00100000:1.0:1787855716.066248:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486226048 00000100:00100000:1.0:1787855716.066311:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787855716.066321:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:5849:x1874702486226048:12345-0@lo:104: 00010000:00010000:1.0:1787855716.066342:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a7402173a00/0x516929ca3366d462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d469 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855716.066392:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787855716.066397:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:5849:x1874702486226048:12345-0@lo:104: Request processed in 78us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855716.066404:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787855716.066502:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787855716.066508:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402173a00/0x516929ca3366d462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d469 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.066515:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402173a00 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:3.0:1787855716.066519:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402173a00/0x516929ca3366d462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d469 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.066527:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402173a00/0x516929ca3366d462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d469 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787855716.066534:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402173a00/0x516929ca3366d462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d469 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855716.066549:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787855716.066579:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402173a00/0x516929ca3366d462 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d469 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.066585:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787855716.066601:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402173a00/0x516929ca3366d462 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d469 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.066608:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402173a00/0x516929ca3366d462 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d469 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.066623:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855716.066625:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855716.066626:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855716.066637:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486226176:0@lo:103: 00000100:00100000:3.0:1787855716.066666:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855716.066702:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486226176 00000100:00100000:3.0:1787855716.066706:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486226176 00010000:00010000:3.0:1787855716.066721:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a7402046600/0x516929ca3366d469 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d462 expref: 15 pid: 5826 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855716.066740:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787855716.066746:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c53d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:3306:x1874702486226176:12345-0@lo:103: 00010000:00010000:3.0:1787855716.066755:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855716.066760:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a7402046600/0x516929ca3366d469 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d462 expref: 15 pid: 5826 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.066768:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a7402046600/0x516929ca3366d469 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d462 expref: 15 pid: 5826 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.066816:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a7402172200/0x516929ca3366d518 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.066822:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402172200/0x516929ca3366d518 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787855716.066835:0:5820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002294828s 00010000:00010000:3.0:1787855716.066839:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a7402172200/0x516929ca3366d518 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.066845:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a7402172200/0x516929ca3366d518 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.066852:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a7402172200/0x516929ca3366d518 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.066858:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a7402172200/0x516929ca3366d518 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.066863:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402172200 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787855716.066867:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a7402172200/0x516929ca3366d518 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.066874:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a7402172200/0x516929ca3366d518 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.066882:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a7402172200/0x516929ca3366d518 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.066890:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855716.066918:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c53d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:3306:x1874702486226176:12345-0@lo:103: Request processed in 172us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855716.066930:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787855716.067001:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486226176:0@lo:103: 00010000:00010000:3.0:1787855716.067027:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402046600/0x516929ca3366d469 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d462 expref: 14 pid: 5826 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855716.067045:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874702486226048:0@lo:104: 00010000:00010000:3.0:1787855716.067058:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a7402172200/0x516929ca3366d518 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.067067:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a7402172200/0x516929ca3366d518 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.067073:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a7402172200/0x516929ca3366d518 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855716.067079:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402172200/0x516929ca3366d518 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855716.073546:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:7610:x1874702486225792:12345-0@lo:253: Request processed in 30951us (31165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855716.073561:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787855716.073651:0:7610:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2adc339-cccb-4166-8f83-87a1e9e399f1:7610:1874702486225792:0@lo:253: 10000000:01000000:3.0:1787855716.073667:0:7610:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787855716.073671:0:7610:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787855716.073672:0:7610:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787855716.073674:0:7610:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787855716.073675:0:7610:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787855716.073676:0:7610:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787855716.073677:0:7610:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787855716.073679:0:7610:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787855716.073681:0:7610:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787855716.073682:0:7610:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787855716.073684:0:7610:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787855716.073685:0:7610:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787855716.073715:0:7610:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787855716.077988:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787855716.078261:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787855716.078474:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787855716.078634:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787855716.079206:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787855716.079458:0:7610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787855716.080517:0:7610:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1787855716.092117:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787855716.345556:0:7610:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787855716.345566:0:7610:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787855716.345608:0:7610:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787855716.345674:0:7610:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787855716.345696:0:7610:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787855716.345713:0:7610:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787855717.115996:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855718.145957:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855719.164925:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855719.548005:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787855719.548030:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486226304:0@lo:13: 00000100:00100000:0.0:1787855719.548113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855719.548204:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486226304 00000100:00100000:0.0:1787855719.548212:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486226304 00000100:00100000:0.0:1787855719.548267:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787855719.548275:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3355a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486226304:12345-0@lo:13: 00002000:00000024:0.0:1787855719.548308:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855719.548355:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3355a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486226304:12345-0@lo:13: Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855719.548362:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787855719.548379:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787855719.548579:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a72c3356580 x1874702486226304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855719.548601:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486226304:0@lo:13: 00010000:00010000:1.0:1787855720.188037:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855721.087868:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486226816:0@lo:400: 00000100:00100000:3.0:1787855721.087883:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486226560:0@lo:400: 00000100:00100000:2.0:1787855721.088034:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc256940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486226432:0@lo:400: 00000100:00100000:1.0:1787855721.088731:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855721.088758:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855721.088817:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787855721.088826:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486226688:0@lo:400: 00000100:00100000:1.0:1787855721.088870:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855721.088903:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486226560 00000100:00100000:1.0:1787855721.088911:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486226560 00000100:00100000:1.0:1787855721.088960:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486226688 00000100:00100000:1.0:1787855721.088963:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486226688 00000100:00100000:1.0:1787855721.088990:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787855721.088999:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486226560:12345-0@lo:400: 00000100:00100000:1.0:1787855721.089047:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486226560:12345-0@lo:400: Request processed in 49us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855721.089054:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787855721.089071:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787855721.089077:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc257840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486226688:12345-0@lo:400: 00000100:00100000:1.0:1787855721.089106:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc257840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486226688:12345-0@lo:400: Request processed in 29us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855721.089118:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787855721.089135:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787855721.089161:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73cc2543c0 x1874702486226688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855721.089175:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486226688:0@lo:400: 00010000:00080000:3.0:1787855721.091603:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73cc254000 x1874702486226560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855721.091621:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486226560:0@lo:400: 00000100:00100000:3.0:1787855721.093844:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486226816 00000100:00100000:3.0:1787855721.094145:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486226816 00000100:00100000:3.0:1787855721.094213:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787855721.094223:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc254b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486226816:12345-0@lo:400: 00000100:00100000:3.0:1787855721.094311:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc254b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486226816:12345-0@lo:400: Request processed in 90us (5657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855721.094319:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787855721.094339:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787855721.094373:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73cc2552c0 x1874702486226816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855721.094398:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486226816:0@lo:400: 00000100:00100000:2.0:1787855721.094821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855721.094855:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486226432 00000100:00100000:2.0:1787855721.094861:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486226432 00000100:00100000:2.0:1787855721.094891:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787855721.094898:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:3304:x1874702486226432:12345-0@lo:400: 00000100:00100000:2.0:1787855721.095000:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:3304:x1874702486226432:12345-0@lo:400: Request processed in 102us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855721.095006:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787855721.095055:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc256940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486226432:0@lo:400: 00000100:00100000:2.0:1787855721.095073:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc256580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486226944:0@lo:400: 00000100:00100000:2.0:1787855721.095107:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855721.095131:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486226944 00000100:00100000:2.0:1787855721.095134:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486226944 00000100:00100000:2.0:1787855721.095170:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787855721.095177:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7420780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486226944:12345-0@lo:400: 00000100:00100000:2.0:1787855721.095207:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7420780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486226944:12345-0@lo:400: Request processed in 30us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855721.095213:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787855721.095234:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787855721.095253:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73cc256580 x1874702486226944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855721.095263:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc256580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486226944:0@lo:400: 00010000:00010000:0.0:1787855721.212194:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855722.236574:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787855722.608496:0:7967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787855723.261733:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855724.283910:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855724.668235:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787855724.668263:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486227072:0@lo:13: 00000100:00100000:2.0:1787855724.668329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855724.668453:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486227072 00000100:00100000:0.0:1787855724.668462:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486227072 00000100:00100000:0.0:1787855724.668525:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787855724.668546:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7421a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486227072:12345-0@lo:13: 00002000:00000024:0.0:1787855724.668579:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855724.668626:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7421a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486227072:12345-0@lo:13: Request processed in 83us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855724.668633:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787855724.668696:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a72c33561c0 x1874702486227072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855724.668713:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486227072:0@lo:13: 00000100:00080000:2.0:1787855724.668788:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1787855725.181196:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787855725.181204:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a73d0d01000 from 30 10000000:01000000:0.0:1787855725.181210:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787855725.181253:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143800/0x516929ca3366d51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855725.181265:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c5143800/0x516929ca3366d51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855725.181277:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c5143800/0x516929ca3366d51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855725.181301:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33561c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486227200:0@lo:101: 00000100:00100000:0.0:1787855725.181379:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855725.181456:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80fa000 going to sleep for 11 seconds 00000100:00100000:1.0:1787855725.181537:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486227200 00000100:00100000:1.0:1787855725.181546:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486227200 00000100:00100000:1.0:1787855725.181639:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787855725.181650:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:5830:x1874702486227200:12345-0@lo:101: 00010000:00010000:1.0:1787855725.181674:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855725.181687:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d51f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.181712:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d51f expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.181724:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d51f expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.181733:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166ce00, rc 0) 00000100:00100000:1.0:1787855725.181810:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:5830:x1874702486227200:12345-0@lo:101: Request processed in 162us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855725.181817:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787855725.181904:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33561c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486227200:0@lo:101: 00010000:00010000:0.0:1787855725.181920:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c5143800/0x516929ca3366d51f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d526 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855725.181938:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c5143800/0x516929ca3366d51f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d526 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855725.182158:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33561c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486227328:0@lo:501: 00000100:00100000:0.0:1787855725.182185:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855725.194619:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80fa000 going to sleep for 11 seconds 00000100:00100000:2.0:1787855725.198329:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486227328 00000100:00100000:2.0:1787855725.198346:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486227328 00000100:00100000:2.0:1787855725.198419:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787855725.198430:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:5830:x1874702486227328:12345-0@lo:501: 00000100:00100000:2.0:1787855725.198902:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:5830:x1874702486227328:12345-0@lo:501: Request processed in 472us (16713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855725.198912:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787855725.198944:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33561c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486227328:0@lo:501: 00000100:00100000:0.0:1787855725.199011:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33561c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486227456:0@lo:503: 00000100:00100000:0.0:1787855725.199057:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855725.199097:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80fa000 going to sleep for 11 seconds 00000100:00100000:1.0:1787855725.199154:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486227456 00000100:00100000:1.0:1787855725.199159:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486227456 00000100:00100000:1.0:1787855725.199191:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787855725.199207:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:5830:x1874702486227456:12345-0@lo:503: 00000100:00100000:1.0:1787855725.199492:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:5830:x1874702486227456:12345-0@lo:503: Request processed in 285us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855725.199499:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787855725.199637:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33561c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486227456:0@lo:503: 00000100:00100000:0.0:1787855725.200243:0:8071:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33561c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8071:1874702486227584:0@lo:502: 00000100:00100000:0.0:1787855725.200289:0:8071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855725.200358:0:8071:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80fa000 going to sleep for 11 seconds 00000100:00100000:1.0:1787855725.200393:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486227584 00000100:00100000:1.0:1787855725.200398:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486227584 00000100:00100000:1.0:1787855725.200434:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787855725.200442:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:8071:x1874702486227584:12345-0@lo:502: 00000100:00100000:1.0:1787855725.200750:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:8071:x1874702486227584:12345-0@lo:502: Request processed in 307us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855725.200758:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787855725.201068:0:8071:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33561c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8071:1874702486227584:0@lo:502: 00000100:00100000:1.0:1787855725.201193:0:8071:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8071:1874702486227712:0@lo:502: 00000100:00100000:1.0:1787855725.201232:0:8071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855725.201263:0:8071:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73df861840 going to sleep for 11 seconds 00000100:00100000:2.0:1787855725.202280:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486227712 00000100:00100000:2.0:1787855725.202298:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486227712 00000100:00100000:2.0:1787855725.202352:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787855725.202362:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:8071:x1874702486227712:12345-0@lo:502: 00000100:00100000:2.0:1787855725.203852:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:8071:x1874702486227712:12345-0@lo:502: Request processed in 1485us (2613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855725.203864:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787855725.204202:0:8071:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8071:1874702486227712:0@lo:502: 00000040:00080000:0.0:1787855725.204235:0:8071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787855725.208227:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787855725.208263:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787855725.208275:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143800/0x516929ca3366d51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d526 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855725.208287:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c5143800/0x516929ca3366d51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d526 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855725.208297:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787855725.208301:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787855725.208304:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787855725.208342:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855725.208350:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855725.208361:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855725.208384:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7423c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486227840:0@lo:101: 00000100:00100000:2.0:1787855725.208465:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855725.208517:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44dc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855725.208536:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486227840 00000100:00100000:1.0:1787855725.208545:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486227840 00000100:00100000:1.0:1787855725.208606:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787855725.208614:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:5830:x1874702486227840:12345-0@lo:101: 00010000:00010000:1.0:1787855725.208627:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855725.208640:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c166c000/0x516929ca3366d534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d52d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.208662:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c166c000/0x516929ca3366d534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d52d expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.208673:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c166c000/0x516929ca3366d534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d52d expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.208700:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166c000, rc 0) 00000100:00100000:1.0:1787855725.208758:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486227840:12345-0@lo:101: Request processed in 144us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855725.208801:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787855725.208852:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7423c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486227840:0@lo:101: 00010000:00010000:3.0:1787855725.208868:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d52d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d534 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855725.208888:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d52d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d534 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855725.208953:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486227968:0@lo:501: 00000100:00100000:3.0:1787855725.208988:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855725.209007:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d07d53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855725.209230:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486227968 00000100:00100000:0.0:1787855725.209234:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486227968 00000100:00100000:0.0:1787855725.209261:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787855725.209270:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486227968:12345-0@lo:501: 00000100:00100000:0.0:1787855725.209533:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486227968:12345-0@lo:501: Request processed in 264us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855725.209542:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787855725.209569:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486227968:0@lo:501: 00000100:00100000:1.0:1787855725.209664:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486228096:0@lo:503: 00000100:00100000:1.0:1787855725.209705:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855725.209729:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73df861300 going to sleep for 11 seconds 00000100:00100000:0.0:1787855725.210274:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486228096 00000100:00100000:0.0:1787855725.210279:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486228096 00000100:00100000:0.0:1787855725.210312:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787855725.210319:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486228096:12345-0@lo:503: 00000100:00100000:0.0:1787855725.210639:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486228096:12345-0@lo:503: Request processed in 319us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855725.210645:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787855725.212223:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486228096:0@lo:503: 00000100:00100000:1.0:1787855725.212942:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2570c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8072:1874702486228224:0@lo:502: 00000100:00100000:1.0:1787855725.213152:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855725.213236:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73df8616c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855725.223812:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486228224 00000100:00100000:2.0:1787855725.223842:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486228224 00000100:00100000:3.0:1787855725.224229:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787855725.224240:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:8072:x1874702486228224:12345-0@lo:502: 00000100:00100000:3.0:1787855725.224555:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:8072:x1874702486228224:12345-0@lo:502: Request processed in 316us (11402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855725.224562:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787855725.225338:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2570c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8072:1874702486228224:0@lo:502: 00000020:01000000:2.0:1787855725.225373:0:8072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787855725.225384:0:8072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787855725.225386:0:8072:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787855725.225391:0:8072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787855725.225393:0:8072:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787855725.225421:0:8072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74212c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8072:1874702486228352:0@lo:502: 00000100:00100000:2.0:1787855725.225481:0:8072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855725.225517:0:8072:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44dc480 going to sleep for 11 seconds 00000100:00100000:0.0:1787855725.225617:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486228352 00000100:00100000:0.0:1787855725.225627:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486228352 00000100:00100000:0.0:1787855725.225667:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787855725.225674:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:8072:x1874702486228352:12345-0@lo:502: 00000100:00100000:0.0:1787855725.225891:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:8072:x1874702486228352:12345-0@lo:502: Request processed in 217us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855725.225898:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787855725.226203:0:8072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74212c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8072:1874702486228352:0@lo:502: 00000020:01000000:2.0:1787855725.226224:0:8072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787855725.226228:0:8072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787855725.226229:0:8072:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787855725.226233:0:8072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1787855725.226393:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787855725.226410:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787855725.226421:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d52d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d534 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.226431:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d534 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787855725.226441:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787855725.226444:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a73f4b59000 from 30 10000000:01000000:1.0:1787855725.226447:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787855725.226472:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166c600/0x516929ca3366d53b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.226490:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c166c600/0x516929ca3366d53b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.226500:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c166c600/0x516929ca3366d53b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855725.226513:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc254f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486228480:0@lo:101: 00000100:00100000:1.0:1787855725.226560:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855725.226589:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73df8616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855725.229859:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486228480 00000100:00100000:0.0:1787855725.229874:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486228480 00000100:00100000:0.0:1787855725.229956:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787855725.229966:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486228480:12345-0@lo:101: 00010000:00010000:0.0:1787855725.229992:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855725.230010:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c5142200/0x516929ca3366d542 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d53b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855725.230035:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c5142200/0x516929ca3366d542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d53b expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855725.230045:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c5142200/0x516929ca3366d542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d53b expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855725.230052:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142200, rc 0) 00000100:00100000:0.0:1787855725.230128:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486228480:12345-0@lo:101: Request processed in 164us (3567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855725.230134:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787855725.230697:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc254f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486228480:0@lo:101: 00010000:00010000:1.0:1787855725.230716:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c166c600/0x516929ca3366d53b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d542 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.230726:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c166c600/0x516929ca3366d53b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d542 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855725.230827:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc254f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486228608:0@lo:501: 00000100:00100000:1.0:1787855725.230864:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855725.230904:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73df8616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855725.231115:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486228608 00000100:00100000:0.0:1787855725.231120:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486228608 00000100:00100000:0.0:1787855725.231184:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787855725.231191:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486228608:12345-0@lo:501: 00000100:00100000:0.0:1787855725.231429:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486228608:12345-0@lo:501: Request processed in 237us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855725.231455:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787855725.231522:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc254f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486228608:0@lo:501: 00000100:00100000:1.0:1787855725.231562:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc254f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486228736:0@lo:503: 00000100:00100000:1.0:1787855725.231600:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855725.241537:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73df8616c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855725.241649:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486228736 00000100:00100000:2.0:1787855725.241661:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486228736 00000100:00100000:3.0:1787855725.241970:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787855725.241980:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486228736:12345-0@lo:503: 00000100:00100000:3.0:1787855725.242218:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486228736:12345-0@lo:503: Request processed in 238us (10617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855725.242226:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787855725.242578:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc254f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486228736:0@lo:503: 00000100:00100000:1.0:1787855725.245366:0:8073:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc254f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8073:1874702486228864:0@lo:502: 00000100:00100000:1.0:1787855725.245449:0:8073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855725.245505:0:8073:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73df861e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787855725.245858:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486228864 00000100:00100000:3.0:1787855725.245865:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486228864 00000100:00100000:3.0:1787855725.245925:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787855725.245940:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c54dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:8073:x1874702486228864:12345-0@lo:502: 00000100:00100000:3.0:1787855725.246170:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c54dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:8073:x1874702486228864:12345-0@lo:502: Request processed in 231us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855725.246178:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787855725.246290:0:8073:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc254f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8073:1874702486228864:0@lo:502: 00000100:00100000:1.0:1787855725.246335:0:8073:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc254f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8073:1874702486228992:0@lo:502: 00000100:00100000:1.0:1787855725.246365:0:8073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855725.246387:0:8073:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73df861e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787855725.246473:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486228992 00000100:00100000:0.0:1787855725.246478:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486228992 00000100:00100000:0.0:1787855725.246506:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787855725.246513:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:8073:x1874702486228992:12345-0@lo:502: 00000100:00100000:0.0:1787855725.246718:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:8073:x1874702486228992:12345-0@lo:502: Request processed in 205us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855725.246725:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787855725.254554:0:8073:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc254f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8073:1874702486228992:0@lo:502: 00000040:00080000:2.0:1787855725.254642:0:8073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787855725.256627:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787855725.256669:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787855725.256683:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166c600/0x516929ca3366d53b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d542 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855725.256695:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c166c600/0x516929ca3366d53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d542 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855725.256707:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787855725.256709:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a73f4b59000 from 5 10000000:01000000:0.0:1787855725.256712:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787855725.256759:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855725.256767:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855725.256822:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855725.256865:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33561c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486229120:0@lo:101: 00000100:00100000:0.0:1787855725.256941:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855725.256986:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c3307600 going to sleep for 11 seconds 00000100:00100000:2.0:1787855725.257224:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486229120 00000100:00100000:2.0:1787855725.257233:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486229120 00000100:00100000:2.0:1787855725.257276:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787855725.257285:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486229120:12345-0@lo:101: 00010000:00010000:2.0:1787855725.257297:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855725.257326:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402046600/0x516929ca3366d550 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d549 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855725.257348:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402046600/0x516929ca3366d550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d549 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855725.257373:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402046600/0x516929ca3366d550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d549 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855725.257383:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402046600, rc 0) 00000100:00100000:2.0:1787855725.257432:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486229120:12345-0@lo:101: Request processed in 148us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855725.257440:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787855725.257527:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33561c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486229120:0@lo:101: 00010000:00010000:1.0:1787855725.257540:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d550 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.257549:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d550 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855725.257606:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486229248:0@lo:256: 00000100:00100000:1.0:1787855725.257640:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855725.257671:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73df861480 going to sleep for 11 seconds 00000100:00100000:3.0:1787855725.257736:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486229248 00000100:00100000:3.0:1787855725.257741:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486229248 00000100:00100000:3.0:1787855725.257796:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787855725.257804:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486229248:12345-0@lo:256: 20000000:01000000:3.0:1787855725.257817:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787855725.257833:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787855725.257836:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787855725.257928:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486229248:12345-0@lo:256: Request processed in 124us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855725.257935:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787855725.258008:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486229248:0@lo:256: 10000000:01000000:1.0:1787855725.258048:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787855725.258054:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d550 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.258061:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d550 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787855725.258068:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787855725.258070:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787855725.258073:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787855725.258090:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166d400/0x516929ca3366d557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.258102:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c166d400/0x516929ca3366d557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.258111:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c166d400/0x516929ca3366d557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855725.258123:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486229376:0@lo:101: 00000100:00100000:1.0:1787855725.258147:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855725.258171:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73df861480 going to sleep for 11 seconds 00000100:00100000:3.0:1787855725.258336:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486229376 00000100:00100000:3.0:1787855725.258340:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486229376 00000100:00100000:3.0:1787855725.258360:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787855725.258366:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486229376:12345-0@lo:101: 00010000:00010000:3.0:1787855725.258373:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855725.258384:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402173a00/0x516929ca3366d55e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d557 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855725.258398:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402173a00/0x516929ca3366d55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d557 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855725.258406:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402173a00/0x516929ca3366d55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d557 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855725.258412:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402173a00, rc 0) 00000100:00100000:3.0:1787855725.258457:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486229376:12345-0@lo:101: Request processed in 91us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855725.258463:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787855725.258530:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486229376:0@lo:101: 00010000:00010000:1.0:1787855725.258541:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c166d400/0x516929ca3366d557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d55e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.258548:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c166d400/0x516929ca3366d557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d55e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855725.258593:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486229504:0@lo:501: 00000100:00100000:1.0:1787855725.258618:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855725.258639:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73df861480 going to sleep for 11 seconds 00000100:00100000:3.0:1787855725.258684:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486229504 00000100:00100000:3.0:1787855725.258688:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486229504 00000100:00100000:3.0:1787855725.258703:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787855725.258709:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486229504:12345-0@lo:501: 00000100:00100000:3.0:1787855725.258972:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486229504:12345-0@lo:501: Request processed in 262us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855725.258978:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787855725.259051:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486229504:0@lo:501: 00000100:00100000:1.0:1787855725.259077:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486229632:0@lo:503: 00000100:00100000:1.0:1787855725.259114:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855725.259135:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73df861480 going to sleep for 11 seconds 00000100:00100000:3.0:1787855725.259589:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486229632 00000100:00100000:3.0:1787855725.259593:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486229632 00000100:00100000:3.0:1787855725.259614:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787855725.259620:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486229632:12345-0@lo:503: 00000100:00100000:3.0:1787855725.259958:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486229632:12345-0@lo:503: Request processed in 336us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855725.259964:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787855725.260077:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2570c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486229632:0@lo:503: 00000100:00100000:1.0:1787855725.260507:0:8074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2570c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8074:1874702486229760:0@lo:502: 00000100:00100000:1.0:1787855725.260556:0:8074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855725.260591:0:8074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73df8616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855725.260639:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486229760 00000100:00100000:0.0:1787855725.260645:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486229760 00000100:00100000:0.0:1787855725.260679:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787855725.260687:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:8074:x1874702486229760:12345-0@lo:502: 00000100:00100000:0.0:1787855725.260967:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:8074:x1874702486229760:12345-0@lo:502: Request processed in 280us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855725.260974:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787855725.261056:0:8074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2570c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8074:1874702486229760:0@lo:502: 00000020:01000000:1.0:1787855725.261078:0:8074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787855725.261086:0:8074:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787855725.261092:0:8074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855725.261095:0:8074:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787855725.261100:0:8074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787855725.261104:0:8074:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:01000000:1.0:1787855725.261125:0:8074:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787855725.261128:0:8074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787855725.261142:0:8074:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a72c2bd0000) 00000020:00000080:1.0:1787855725.261162:0:8074:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787855725.261167:0:8074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787855725.261243:0:8074:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787855725.261248:0:8074:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787855725.261255:0:8074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x516929ca3366d56c 00010000:00080000:1.0:1787855725.261284:0:8074:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a73fa3cf000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:1.0:1787855725.261512:0:8074:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1787855725.261862:0:8074:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787855725.261883:0:8074:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787855725.262366:0:8074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787855725.262570:0:8074:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787855725.262624:0:8074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787855725.262686:0:8074:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787855725.264929:0:8075:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787855725.264937:0:8075:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787855725.266197:0:8074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787855725.266211:0:8074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787855725.266246:0:8074:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787855725.266268:0:8074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x516929ca3366d573 00000100:00080000:1.0:1787855725.266279:0:8074:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787855725.266298:0:8074:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a73fa3cf000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1787855725.266336:0:8074:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73cc2570c0 x1874702486229888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787855725.266393:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486229888:0@lo:8: 00000100:00100000:3.0:1787855725.266468:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787855725.266560:0:8074:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787855725.266611:0:8074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787855725.266615:0:8074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855725.266617:0:8074:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787855725.266620:0:8074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787855725.266623:0:8074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855725.266625:0:8074:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787855725.266627:0:8074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787855725.266629:0:8074:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787855725.266652:0:8074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8074:1874702486230016:0@lo:502: 00000100:00100000:1.0:1787855725.266692:0:8074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855725.266705:0:8074:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c56c5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787855725.266750:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486229888 00000100:00100000:2.0:1787855725.266757:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486229888 00000100:00100000:2.0:1787855725.266821:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787855725.266828:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3303:x1874702486229888:12345-0@lo:8: 00010000:00080000:2.0:1787855725.266849:0:6681:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:2.0:1787855725.266888:0:6681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x516929ca3366d57a 00002000:00100000:2.0:1787855725.266902:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a73fa51d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787855725.266907:0:6681:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787855725.266911:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787855725.267035:0:6681:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787855725.267178:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787855725.267205:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9a73fa51c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787855725.267415:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3354780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486230272:0@lo:400: 00000100:00100000:0.0:1787855725.267447:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855725.267475:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787855725.267481:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486230144:0@lo:400: 00000100:00100000:0.0:1787855725.267502:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855725.267526:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3355680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486230400:0@lo:400: 00000100:00100000:0.0:1787855725.267550:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855725.267568:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787855725.267574:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3355e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486230528:0@lo:400: 00000100:00100000:0.0:1787855725.267597:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855725.267627:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486230272 00000100:00100000:0.0:1787855725.267631:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486230272 00000100:00100000:0.0:1787855725.267663:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486230144 00000100:00100000:0.0:1787855725.267666:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486230144 00000100:00100000:0.0:1787855725.267677:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486230528 00000100:00100000:0.0:1787855725.267680:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486230528 00000100:00100000:0.0:1787855725.267704:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787855725.267711:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3354b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486230272:12345-0@lo:400: 00000100:00100000:0.0:1787855725.267748:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3354b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486230272:12345-0@lo:400: Request processed in 37us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855725.267754:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787855725.267770:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787855725.267799:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3356940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486230144:12345-0@lo:400: 00000100:00100000:0.0:1787855725.267825:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3356940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486230144:12345-0@lo:400: Request processed in 51us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855725.267831:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787855725.267841:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787855725.267847:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c33543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486230528:12345-0@lo:400: 00000100:00100000:0.0:1787855725.267886:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c33543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486230528:12345-0@lo:400: Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855725.267892:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787855725.267914:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787855725.267922:0:6680:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1787855725.267938:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787855725.267963:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a72c3355e00 x1874702486230528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855725.267975:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3355e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486230528:0@lo:400: 00010000:00080000:0.0:1787855725.268012:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a72c3357480 x1874702486230144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855725.268020:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486230144:0@lo:400: 00010000:00080000:0.0:1787855725.268030:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a72c3354780 x1874702486230272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855725.268049:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3354780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486230272:0@lo:400: 00000100:00100000:0.0:1787855725.268176:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486230016 00000100:00100000:0.0:1787855725.268181:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486230016 00000100:00100000:0.0:1787855725.268207:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787855725.268213:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:8074:x1874702486230016:12345-0@lo:502: 00000100:00100000:0.0:1787855725.268443:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:8074:x1874702486230016:12345-0@lo:502: Request processed in 230us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855725.268450:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787855725.268578:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486230400 00000100:00100000:0.0:1787855725.268582:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486230400 00000100:00100000:0.0:1787855725.268606:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787855725.268614:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787855725.268620:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c33552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486230400:12345-0@lo:400: 00000100:00100000:0.0:1787855725.268656:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c33552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486230400:12345-0@lo:400: Request processed in 36us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855725.268662:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787855725.268687:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a72c3355680 x1874702486230400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855725.268698:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3355680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486230400:0@lo:400: 00000100:00100000:1.0:1787855725.269056:0:8074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8074:1874702486230016:0@lo:502: 00000020:01000000:1.0:1787855725.269083:0:8074:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787855725.269089:0:8074:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855725.269091:0:8074:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787855725.269096:0:8074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787855725.269257:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787855725.269276:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787855725.269287:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166d400/0x516929ca3366d557 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d55e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855725.269298:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c166d400/0x516929ca3366d557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d55e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855725.269318:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787855725.269321:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a73c44919d0 from 1 10000000:01000000:0.0:1787855725.269324:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787855725.269350:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5142c00/0x516929ca3366d581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855725.269358:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c5142c00/0x516929ca3366d581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855725.269367:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c5142c00/0x516929ca3366d581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855725.269383:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3355680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486230656:0@lo:101: 00000100:00100000:0.0:1787855725.269418:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855725.269483:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c3307000 going to sleep for 11 seconds 00000100:00100000:2.0:1787855725.270357:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1874702486229888:12345-0@lo:8: Request processed in 3524us (3885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855725.270368:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787855725.279481:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73cc2570c0 x1874702486229888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787855735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855725.279497:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787855725.279507:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787855725.279517:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787855725.279523:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787855725.279542:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73fa3cf000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787855725.279566:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787855725.279573:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486229888:0@lo:8: 00000004:00080000:3.0:1787855725.279610:0:8075:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787855725.279746:0:8075:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 216131970074ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787855725.287615:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486230656 00000100:00100000:1.0:1787855725.287627:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486230656 00000100:00100000:1.0:1787855725.288126:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787855725.288137:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486230656:12345-0@lo:101: 00010000:00010000:1.0:1787855725.288154:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855725.288169:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c166d600/0x516929ca3366d588 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d581 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.288195:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c166d600/0x516929ca3366d588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d581 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.288213:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c166d600/0x516929ca3366d588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d581 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.288222:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166d600, rc 0) 00000100:00100000:1.0:1787855725.288293:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486230656:12345-0@lo:101: Request processed in 158us (18875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855725.288299:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787855725.288339:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3355680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486230656:0@lo:101: 00010000:00010000:1.0:1787855725.288354:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c5142c00/0x516929ca3366d581 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d588 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.288363:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c5142c00/0x516929ca3366d581 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d588 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855725.288427:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486230784:0@lo:501: 00000100:00100000:1.0:1787855725.288456:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855725.288480:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c56c5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787855725.288492:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486230784 00000100:00100000:1.0:1787855725.288495:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486230784 00000100:00100000:1.0:1787855725.288509:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787855725.288514:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486230784:12345-0@lo:501: 00000100:00100000:1.0:1787855725.288700:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486230784:12345-0@lo:501: Request processed in 184us (242us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787855725.288706:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787855725.288731:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486230784:0@lo:501: 10000000:01000000:1.0:1787855725.288749:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787855725.288760:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5142c00/0x516929ca3366d581 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d588 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855725.288768:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c5142c00/0x516929ca3366d581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d588 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855725.309903:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787855725.323425:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787855725.369662:0:8076:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787855725.369703:0:8076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d8960780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8076:1874702486231040:0@lo:7: 00000100:00100000:3.0:1787855725.369823:0:8076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855725.369882:0:8076:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d0662540 going to sleep for 11 seconds 00000100:00100000:0.0:1787855725.370181:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787855725.370197:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486230912:0@lo:13: 00000100:00100000:0.0:1787855725.370237:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855725.370280:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486231040 00000100:00100000:0.0:1787855725.370288:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486231040 00000100:00100000:0.0:1787855725.370520:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787855725.370530:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9280780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8076:x1874702486231040:12345-0@lo:7: 00000100:00100000:1.0:1787855725.371479:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486230912 00000100:00100000:1.0:1787855725.371488:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486230912 00000100:00100000:1.0:1787855725.371539:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787855725.371549:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3354780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874702486230912:12345-0@lo:13: 00002000:00000024:1.0:1787855725.371754:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787855725.371854:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3354780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874702486230912:12345-0@lo:13: Request processed in 306us (1615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855725.371861:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787855725.371958:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73cb7a5e00 x1874702486230912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855725.371989:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486230912:0@lo:13: 00000100:00080000:2.0:1787855725.372227:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1787855725.392504:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787855725.392515:0:6680:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787855725.392627:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9280780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8076:x1874702486231040:12345-0@lo:7: Request processed in 22094us (22800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855725.392638:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787855725.393075:0:8076:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d8960780 x1874702486231040/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787855741 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855725.393090:0:8076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d8960780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8076:1874702486231040:0@lo:7: 00000004:00080000:3.0:1787855725.393104:0:8076:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787855725.393144:0:8076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9281680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8076:1874702486231168:0@lo:5: 00000100:00100000:3.0:1787855725.393184:0:8076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855725.393249:0:8076:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d0662540 going to sleep for 11 seconds 00000100:00100000:2.0:1787855725.393389:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486231168 00000100:00100000:2.0:1787855725.393397:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486231168 00000100:00100000:2.0:1787855725.393446:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787855725.393456:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9281e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8076:x1874702486231168:12345-0@lo:5: 00002000:00080000:2.0:1787855725.393480:0:6679:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787855725.393484:0:6679:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787855725.393756:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9281e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8076:x1874702486231168:12345-0@lo:5: Request processed in 301us (570us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787855725.393763:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787855725.394157:0:8076:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73c9281680 x1874702486231168/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787855741 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855725.394183:0:8076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9281680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8076:1874702486231168:0@lo:5: 00000004:00080000:0.0:1787855725.394192:0:8076:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787855725.394218:0:8076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3357480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8076:1874702486231296:0@lo:700: 00000100:00100000:0.0:1787855725.394244:0:8076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855725.394354:0:8076:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d1218b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787855725.397521:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486231296 00000100:00100000:2.0:1787855725.397537:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486231296 00000100:00100000:2.0:1787855725.397653:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787855725.397665:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3355e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8076:x1874702486231296:12345-0@lo:700: 00000100:00100000:2.0:1787855725.397718:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74212c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6687:1874702486231424:0@lo:700: 00000100:00100000:2.0:1787855725.397799:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855725.397843:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44dc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855725.399250:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486231424 00000100:00100000:1.0:1787855725.399261:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486231424 00000100:00100000:1.0:1787855725.399328:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787855725.399337:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7423c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6687:x1874702486231424:12345-0@lo:700: 40000000:02000000:1.0:1787855725.464764:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787855725.481032:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7423c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6687:x1874702486231424:12345-0@lo:700: Request processed in 81689us (83224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855725.481048:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787855725.481254:0:6687:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73e74212c0 x1874702486231424/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787855741 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855725.481274:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74212c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6687:1874702486231424:0@lo:700: 40000000:02000000:2.0:1787855725.481291:0:6687:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1787855725.669738:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1787855725.669750:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787855725.670939:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3355e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8076:x1874702486231296:12345-0@lo:700: Request processed in 273268us (276685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855725.670953:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787855725.671126:0:8076:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a72c3357480 x1874702486231296/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787855741 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855725.671139:0:8076:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787855725.671157:0:8076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3357480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8076:1874702486231296:0@lo:700: 00000004:02000040:1.0:1787855725.711120:0:8076:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787855725.719439:0:8076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8076:1874702486231552:0@lo:5: 00000100:00100000:1.0:1787855725.719515:0:8076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855725.719578:0:8076:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c33073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855725.722463:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486231552 00000100:00100000:2.0:1787855725.722478:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486231552 00000100:00100000:2.0:1787855725.722531:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787855725.722542:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc256580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8076:x1874702486231552:12345-0@lo:5: 00002000:00080000:2.0:1787855725.732232:0:8077:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787855725.732255:0:8077:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787855725.738456:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc256580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8076:x1874702486231552:12345-0@lo:5: Request processed in 15910us (18935us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787855725.738469:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787855725.740199:0:8076:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73cc2543c0 x1874702486231552/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787855741 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855725.740219:0:8076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8076:1874702486231552:0@lo:5: 00000004:00080000:3.0:1787855725.740235:0:8076:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787855726.332162:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855727.356096:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787855727.637520:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1787855728.346481:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855728.346559:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464188544 00000100:00100000:3.0:1787855728.346578:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464188544 00000100:00100000:3.0:1787855728.346630:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 110 00000100:00100000:3.0:1787855728.346638:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2356:x1874702464188544:12345-192.168.201.38@tcp:250: 00010000:00080000:3.0:1787855728.346665:0:5826:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 3d78451b-7acd-4478-9bc5-3a00d72e2604@192.168.201.38@tcp t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:3.0:1787855728.346692:0:5826:0:(genops.c:1385:class_connect()) connect: client 3d78451b-7acd-4478-9bc5-3a00d72e2604, cookie 0x516929ca3366d58f 00000100:00080000:3.0:1787855728.346872:0:5826:0:(import.c:65:import_set_state_nolock()) ffff9a72c1322800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787855728.346946:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+5:2356:x1874702464188544:12345-192.168.201.38@tcp:250: Request processed in 307us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855728.346955:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 110 00000100:00100000:1.0:1787855728.367155:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855728.367230:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464188672 00000100:00100000:0.0:1787855728.367240:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464188672 00000100:00100000:0.0:1787855728.367293:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 111 00000100:00100000:0.0:1787855728.367303:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+5:5584:x1874702464188672:12345-192.168.201.38@tcp:101: 00010000:00010000:0.0:1787855728.367319:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855728.367336:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c5143200/0x516929ca3366d596 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c9306169bf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855728.367364:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c5143200/0x516929ca3366d596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169bf expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855728.367375:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c5143200/0x516929ca3366d596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169bf expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855728.367383:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143200, rc 0) 00000100:00100000:0.0:1787855728.368093:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+6:5584:x1874702464188672:12345-192.168.201.38@tcp:101: Request processed in 788us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855728.368101:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 111 00000100:00100000:3.0:1787855728.373404:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855728.373485:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464188800 00000100:00100000:0.0:1787855728.373508:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464188800 00000100:00100000:0.0:1787855728.373560:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 112 00000100:00100000:0.0:1787855728.373569:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+6:5584:x1874702464188800:12345-192.168.201.38@tcp:501: 00000100:00100000:0.0:1787855728.373975:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+6:5584:x1874702464188800:12345-192.168.201.38@tcp:501: Request processed in 405us (581us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787855728.373984:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 112 00000100:00100000:2.0:1787855728.378407:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855728.378484:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464188928 00000100:00100000:0.0:1787855728.378494:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464188928 00000100:00100000:0.0:1787855728.378552:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 113 00000100:00100000:0.0:1787855728.378563:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+6:5584:x1874702464188928:12345-192.168.201.38@tcp:101: 00010000:00010000:0.0:1787855728.378581:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855728.378602:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c5143400/0x516929ca3366d59d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c9306169c6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855728.378633:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c5143400/0x516929ca3366d59d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169c6 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855728.378645:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c5143400/0x516929ca3366d59d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169c6 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855728.378655:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143400, rc 0) 00000100:00100000:0.0:1787855728.378876:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+7:5584:x1874702464188928:12345-192.168.201.38@tcp:101: Request processed in 314us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855728.378883:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 113 00010000:00010000:1.0:1787855728.379886:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855728.381766:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855728.381884:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464189056 00000100:00100000:3.0:1787855728.381893:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464189056 00000100:00100000:3.0:1787855728.381944:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 114 00000100:00100000:3.0:1787855728.381955:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+7:5584:x1874702464189056:12345-192.168.201.38@tcp:501: 00000100:00100000:3.0:1787855728.382282:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+8:5584:x1874702464189056:12345-192.168.201.38@tcp:501: Request processed in 328us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855728.382291:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 114 00000100:00100000:3.0:1787855728.384591:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855728.384690:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464189184 00000100:00100000:0.0:1787855728.384699:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464189184 00000100:00100000:0.0:1787855728.384748:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 115 00000100:00100000:0.0:1787855728.384758:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+8:5584:x1874702464189184:12345-192.168.201.38@tcp:503: 00000100:00100000:2.0:1787855728.389073:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+8:5584:x1874702464189184:12345-192.168.201.38@tcp:503: Request processed in 4132us (4308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855728.389088:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 115 00000100:00100000:2.0:1787855728.404634:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855728.404719:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464189312 00000100:00100000:1.0:1787855728.404729:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464189312 00000100:00100000:1.0:1787855728.404832:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 116 00000100:00100000:1.0:1787855728.404843:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+8:5603:x1874702464189312:12345-192.168.201.38@tcp:502: 00000100:00100000:1.0:1787855728.405205:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+8:5603:x1874702464189312:12345-192.168.201.38@tcp:502: Request processed in 362us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855728.405213:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 116 00000100:00100000:1.0:1787855728.453886:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855728.454034:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464189440 00000100:00100000:2.0:1787855728.454044:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464189440 00000100:00100000:2.0:1787855728.454101:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 117 00000100:00100000:2.0:1787855728.454112:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+8:5603:x1874702464189440:12345-192.168.201.38@tcp:502: 00000100:00100000:2.0:1787855728.454511:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+8:5603:x1874702464189440:12345-192.168.201.38@tcp:502: Request processed in 396us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855728.454521:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 117 00000100:00100000:2.0:1787855728.462131:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855728.462333:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464189568 00000100:00100000:3.0:1787855728.462342:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464189568 00000100:00100000:3.0:1787855728.462409:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 118 00000100:00100000:3.0:1787855728.462419:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+8:5584:x1874702464189568:12345-192.168.201.38@tcp:101: 00010000:00010000:3.0:1787855728.462435:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855728.462452:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402173800/0x516929ca3366d5a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c9306169f0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855728.462479:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402173800/0x516929ca3366d5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169f0 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855728.462505:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402173800/0x516929ca3366d5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169f0 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855728.462515:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402173800, rc 0) 00000100:00100000:3.0:1787855728.466888:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+9:5584:x1874702464189568:12345-192.168.201.38@tcp:101: Request processed in 4455us (4753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855728.466902:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 118 00000100:00100000:0.0:1787855728.473171:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855728.473580:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464189696 00000100:00100000:2.0:1787855728.473590:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464189696 00000100:00100000:2.0:1787855728.473664:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00100000:2.0:1787855728.473675:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+9:5584:x1874702464189696:12345-192.168.201.38@tcp:256: 20000000:01000000:2.0:1787855728.473700:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787855728.473726:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787855728.473730:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787855728.473733:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787855728.473736:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787855728.475696:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+9:5584:x1874702464189696:12345-192.168.201.38@tcp:256: Request processed in 2014us (2536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855728.475722:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00100000:3.0:1787855728.479107:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855728.479268:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464189824 00000100:00100000:0.0:1787855728.479279:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464189824 00000100:00100000:0.0:1787855728.479337:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:0.0:1787855728.479353:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+9:5584:x1874702464189824:12345-192.168.201.38@tcp:101: 00010000:00010000:0.0:1787855728.479371:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855728.479389:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d5ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c9306169f7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855728.479416:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d5ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169f7 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855728.479426:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d5ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169f7 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855728.479435:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143c00, rc 0) 00000100:00100000:0.0:1787855728.479495:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5584:x1874702464189824:12345-192.168.201.38@tcp:101: Request processed in 148us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855728.479502:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:0.0:1787855728.485167:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855728.485361:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464189952 00000100:00100000:3.0:1787855728.485371:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464189952 00000100:00100000:3.0:1787855728.485430:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 121 00000100:00100000:3.0:1787855728.485440:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5584:x1874702464189952:12345-192.168.201.38@tcp:501: 00000100:00100000:3.0:1787855728.485753:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5584:x1874702464189952:12345-192.168.201.38@tcp:501: Request processed in 313us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855728.485761:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 121 00000100:00100000:3.0:1787855728.495740:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855728.495867:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464190080 00000100:00100000:1.0:1787855728.495877:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464190080 00000100:00100000:1.0:1787855728.495938:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 122 00000100:00100000:1.0:1787855728.495947:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5584:x1874702464190080:12345-192.168.201.38@tcp:503: 00000100:00100000:1.0:1787855728.496348:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5584:x1874702464190080:12345-192.168.201.38@tcp:503: Request processed in 401us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855728.496357:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 122 00000100:00100000:0.0:1787855728.503056:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855728.503181:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464190208 00000100:00100000:2.0:1787855728.503190:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464190208 00000100:00100000:2.0:1787855728.503253:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 123 00000100:00100000:2.0:1787855728.503264:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5608:x1874702464190208:12345-192.168.201.38@tcp:502: 00000100:00100000:2.0:1787855728.503555:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5608:x1874702464190208:12345-192.168.201.38@tcp:502: Request processed in 291us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855728.503563:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 123 00000100:00100000:0.0:1787855728.508988:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855728.509391:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464190336 00000100:00100000:3.0:1787855728.509402:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464190336 00000100:00100000:3.0:1787855728.509465:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:3.0:1787855728.509475:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5608:x1874702464190336:12345-192.168.201.38@tcp:502: 00000100:00100000:3.0:1787855728.510275:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5608:x1874702464190336:12345-192.168.201.38@tcp:502: Request processed in 796us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855728.510287:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:3.0:1787855728.526226:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855728.526378:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464190464 00000100:00100000:0.0:1787855728.526393:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464190464 00000100:00100000:0.0:1787855728.526464:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:0.0:1787855728.526473:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9282940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2356:x1874702464190464:12345-192.168.201.38@tcp:38: 00010000:00080000:0.0:1787855728.526503:0:5835:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp t0 exp 0000000000000000 cur 219 last 0 00000020:00000080:0.0:1787855728.526564:0:5835:0:(genops.c:1385:class_connect()) connect: client 6933b672-fa85-4aae-9dc8-092c3f355bbf, cookie 0x516929ca3366d5b2 00000004:00100000:0.0:1787855728.526593:0:5835:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787855728.526600:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787855728.612219:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9a73fa3cd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787855728.612371:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9282940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2356:x1874702464190464:12345-192.168.201.38@tcp:38: Request processed in 85896us (86160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855728.612399:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00010000:00010000:2.0:1787855729.404385:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855729.624766:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855729.624920:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855729.625417:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464190720 00000100:00100000:0.0:1787855729.625432:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464190720 00000100:00100000:0.0:1787855729.625531:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464190592 00000100:00100000:0.0:1787855729.625535:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464190592 00000100:00100000:0.0:1787855729.625557:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:0.0:1787855729.625568:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:5584:x1874702464190720:12345-192.168.201.38@tcp:41: 00000004:00000024:0.0:1787855729.625627:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:2.0:1787855729.625757:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855729.625943:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:5584:x1874702464190720:12345-192.168.201.38@tcp:41: Request processed in 375us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855729.625953:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:0.0:1787855729.625976:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:0.0:1787855729.625984:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:0:x1874702464190592:12345-192.168.201.38@tcp:41: 00000004:00000024:0.0:1787855729.625996:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787855729.626031:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:0:x1874702464190592:12345-192.168.201.38@tcp:41: Request processed in 48us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855729.626038:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:0.0:1787855729.628614:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855729.628940:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464190848 00000100:00100000:2.0:1787855729.628953:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464190848 00000100:00100000:2.0:1787855729.629096:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:2.0:1787855729.629110:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3355680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:5584:x1874702464190848:12345-192.168.201.38@tcp:40: 00000100:00100000:2.0:1787855729.629233:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3355680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:5584:x1874702464190848:12345-192.168.201.38@tcp:40: Request processed in 125us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855729.629241:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:2.0:1787855729.632161:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855729.632200:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855729.632359:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855729.632398:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464190976 00000100:00100000:2.0:1787855729.632404:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855729.632413:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464190976 00000100:00100000:2.0:1787855729.632443:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464191232 00000100:00100000:2.0:1787855729.632446:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464191232 00000100:00100000:1.0:1787855729.632463:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464191104 00000100:00100000:1.0:1787855729.632466:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464191104 00000100:00100000:2.0:1787855729.632486:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1787855729.632486:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:1.0:1787855729.632496:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7421680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1874702464190976:12345-192.168.201.38@tcp:8: 00000100:00100000:2.0:1787855729.632513:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:5584:x1874702464191232:12345-192.168.201.38@tcp:33: 00010000:00080000:1.0:1787855729.632536:0:6679:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:1.0:1787855729.632576:0:6679:0:(genops.c:1385:class_connect()) connect: client 6933b672-fa85-4aae-9dc8-092c3f355bbf, cookie 0x516929ca3366d5b9 00002000:00100000:1.0:1787855729.632590:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6933b672-fa85-4aae-9dc8-092c3f355bbf/ffff9a73fa3cc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787855729.632622:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787855729.632631:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:2.0:1787855729.632636:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1874702464191104:12345-192.168.201.38@tcp:8: 00010000:00080000:2.0:1787855729.632652:0:8077:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:2.0:1787855729.632680:0:8077:0:(genops.c:1385:class_connect()) connect: client 6933b672-fa85-4aae-9dc8-092c3f355bbf, cookie 0x516929ca3366d5c0 00002000:00100000:2.0:1787855729.632685:0:8077:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6933b672-fa85-4aae-9dc8-092c3f355bbf/ffff9a73fa51b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787855729.632705:0:8077:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787855729.632728:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464191360 00000100:00100000:0.0:1787855729.632743:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464191360 00000100:00100000:0.0:1787855729.632823:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 125 00000100:00100000:0.0:1787855729.632831:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2360:x1874702464191360:12345-192.168.201.38@tcp:400: 00000100:00100000:0.0:1787855729.632905:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2360:x1874702464191360:12345-192.168.201.38@tcp:400: Request processed in 75us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855729.632922:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 125 00002000:00080000:2.0:1787855729.633164:0:8077:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787855729.633200:0:8077:0:(import.c:65:import_set_state_nolock()) ffff9a73fa51f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787855729.633242:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2356:x1874702464191104:12345-192.168.201.38@tcp:8: Request processed in 604us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855729.633249:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00002000:00080000:1.0:1787855729.637234:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787855729.637411:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9a73fa3cf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787855729.637507:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7421680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2356:x1874702464190976:12345-192.168.201.38@tcp:8: Request processed in 5010us (5357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855729.637520:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000004:00080000:3.0:1787855729.651186:0:5836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 18590us 00000004:00200000:2.0:1787855729.681693:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787855729.683260:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:5584:x1874702464191232:12345-192.168.201.38@tcp:33: Request processed in 50731us (50837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855729.683275:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1787855729.790716:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787855729.790754:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486231680:0@lo:13: 00000100:00100000:1.0:1787855729.790922:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855729.791123:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486231680 00000100:00100000:3.0:1787855729.791139:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486231680 00000100:00080000:2.0:1787855729.791310:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787855729.791339:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787855729.791352:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486231680:12345-0@lo:13: 00002000:00000024:3.0:1787855729.791383:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855729.791478:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486231680:12345-0@lo:13: Request processed in 128us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855729.791486:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787855729.791582:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a72c33561c0 x1874702486231680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855729.791610:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486231680:0@lo:13: 00000100:00100000:2.0:1787855729.851452:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855729.851734:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464191488 00000100:00100000:3.0:1787855729.851747:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464191488 00000100:00100000:3.0:1787855729.851929:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:3.0:1787855729.851943:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:5625:x1874702464191488:12345-192.168.201.38@tcp:101: 00010000:00010000:3.0:1787855729.851969:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855729.853647:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402172200/0x516929ca3366d5c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616a21 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855729.853734:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402172c00/0x516929ca3366d5ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855729.853749:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402172c00/0x516929ca3366d5ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855729.853763:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402172c00/0x516929ca3366d5ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855729.853976:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787855729.853980:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787855729.854299:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402172c00/0x516929ca3366d5ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855729.854338:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402172200/0x516929ca3366d5c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a21 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855729.854359:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402172c00/0x516929ca3366d5ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a21 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855729.854368:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:3.0:1787855729.854371:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787855729.854374:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402172c00, rc 0) 00000100:00100000:3.0:1787855729.854443:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:5625:x1874702464191488:12345-192.168.201.38@tcp:101: Request processed in 2503us (3008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855729.854451:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:2.0:1787855730.300480:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486231808:0@lo:400: 00000100:00100000:3.0:1787855730.300695:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486231936:0@lo:400: 00000100:00100000:3.0:1787855730.300756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855730.300853:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3357840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486232448:0@lo:400: 00000100:00100000:3.0:1787855730.300890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855730.301122:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855730.301403:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486232448 00000100:00100000:3.0:1787855730.301413:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486232448 00000100:00100000:1.0:1787855730.304637:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486231936 00000100:00100000:1.0:1787855730.304651:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486231936 00000100:00100000:1.0:1787855730.304707:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787855730.304717:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c92812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486231936:12345-0@lo:400: 00000100:00100000:1.0:1787855730.307136:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c92812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486231936:12345-0@lo:400: Request processed in 2410us (6370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855730.307149:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787855730.307241:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486232064:0@lo:400: 00000100:00100000:1.0:1787855730.307302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855730.310158:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486232320:0@lo:400: 00000100:00100000:2.0:1787855730.310275:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855730.310814:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3357c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486232192:0@lo:400: 00000100:00100000:2.0:1787855730.310953:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486231808 00000100:00100000:2.0:1787855730.310964:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486231808 00000100:00100000:2.0:1787855730.313256:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787855730.313276:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486231808:12345-0@lo:400: 00000100:00100000:1.0:1787855730.316286:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787855730.317739:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c92803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486232448:12345-0@lo:400: 00000100:00100000:0.0:1787855730.323890:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855730.324514:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486232192 00000100:00100000:0.0:1787855730.324528:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486232192 00000100:00100000:0.0:1787855730.324599:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787855730.324613:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3356d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486232192:12345-0@lo:400: 00000100:00100000:0.0:1787855730.324705:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3356d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486232192:12345-0@lo:400: Request processed in 95us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855730.324713:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787855730.324773:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a72c3357c00 x1874702486232192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855730.324835:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3357c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486232192:0@lo:400: 00000100:00100000:0.0:1787855730.324893:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486232064 00000100:00100000:0.0:1787855730.324897:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486232064 00000100:00100000:0.0:1787855730.324934:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486232320 00000100:00100000:0.0:1787855730.324938:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486232320 00000100:00100000:2.0:1787855730.325175:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486231808:12345-0@lo:400: Request processed in 11903us (24051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855730.325186:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787855730.325241:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486231808:0@lo:400: 00000100:00100000:2.0:1787855730.325290:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787855730.325303:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc2552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486232064:12345-0@lo:400: 00000100:00100000:2.0:1787855730.325594:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc2552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486232064:12345-0@lo:400: Request processed in 294us (18290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855730.325601:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787855730.325640:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486232064:0@lo:400: 00000100:00080000:2.0:1787855730.325848:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787855730.325855:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787855730.326538:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486231936:0@lo:400: 00000100:00080000:2.0:1787855730.327086:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855730.327467:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787855730.327481:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486232320:12345-0@lo:400: 00000100:00100000:0.0:1787855730.327648:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486232320:12345-0@lo:400: Request processed in 170us (17372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855730.327665:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787855730.329725:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c92803c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486232448:12345-0@lo:400: Request processed in 13417us (28830us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855730.329740:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787855730.330238:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a72c3357840 x1874702486232448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855730.330254:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787855730.330278:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3357840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486232448:0@lo:400: 00000100:00100000:3.0:1787855730.333453:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33570c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486232320:0@lo:400: 00010000:00010000:1.0:1787855730.428216:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855730.816936:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc256940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486232576:0@lo:13: 00000100:00100000:2.0:1787855730.817056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855730.817386:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486232576 00000100:00100000:2.0:1787855730.817397:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486232576 00000100:00100000:2.0:1787855730.817467:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787855730.817480:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486232576:12345-0@lo:13: 00002000:00000024:2.0:1787855730.817514:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787855730.817576:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486232576:12345-0@lo:13: Request processed in 98us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855730.817606:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787855730.817664:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73cc256940 x1874702486232576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855730.817689:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc256940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486232576:0@lo:13: 00000001:00100000:2.0:1787855730.934871:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6933b672-fa85-4aae-9dc8-092c3f355bbf 00010000:00010000:2.0:1787855731.452660:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855732.080176:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855732.081009:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464191616 00000100:00100000:2.0:1787855732.081024:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464191616 00000100:00100000:2.0:1787855732.081149:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:2.0:1787855732.081165:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9283c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:5677:x1874702464191616:12345-192.168.201.38@tcp:41: 00000004:00000024:2.0:1787855732.081229:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787855732.081330:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9283c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:5677:x1874702464191616:12345-192.168.201.38@tcp:41: Request processed in 169us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855732.081338:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00080000:0.0:1787855732.083518:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855732.086353:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855732.091830:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464191744 00000100:00100000:1.0:1787855732.091853:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464191744 00000100:00100000:1.0:1787855732.091967:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:1.0:1787855732.091981:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:5677:x1874702464191744:12345-192.168.201.38@tcp:13: 00002000:00000024:1.0:1787855732.092039:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787855732.092151:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:5677:x1874702464191744:12345-192.168.201.38@tcp:13: Request processed in 171us (5814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855732.092160:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00080000:0.0:1787855732.092277:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787855732.102743:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855732.103682:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464191872 00000100:00100000:1.0:1787855732.103699:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464191872 00000100:00100000:1.0:1787855732.103839:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:1.0:1787855732.103854:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9282d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:5677:x1874702464191872:12345-192.168.201.38@tcp:13: 00002000:00000024:1.0:1787855732.103909:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787855732.104003:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9282d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:5677:x1874702464191872:12345-192.168.201.38@tcp:13: Request processed in 152us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855732.104013:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00080000:0.0:1787855732.104233:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787855732.476217:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787855733.448036:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6933b672-fa85-4aae-9dc8-092c3f355bbf 00010000:00010000:3.0:1787855733.500143:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787855733.946142:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6933b672-fa85-4aae-9dc8-092c3f355bbf 00010000:00010000:1.0:1787855734.525503:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855734.707648:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855734.707698:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855734.707741:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855734.707770:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855734.707842:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464192256 00000100:00100000:0.0:1787855734.707856:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464192256 00000100:00100000:0.0:1787855734.707929:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464192384 00000100:00100000:0.0:1787855734.707933:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464192384 00000100:00100000:0.0:1787855734.707960:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:0.0:1787855734.707972:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3357c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2360:x1874702464192256:12345-192.168.201.38@tcp:400: 00000100:00100000:2.0:1787855734.708258:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464192000 00000100:00100000:2.0:1787855734.708264:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464192000 00000100:00100000:2.0:1787855734.708315:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 127 00000100:00100000:2.0:1787855734.708325:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2360:x1874702464192000:12345-192.168.201.38@tcp:400: 00000100:00100000:1.0:1787855734.708413:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:1.0:1787855734.708424:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2360:x1874702464192384:12345-192.168.201.38@tcp:400: 00000100:00100000:0.0:1787855734.713573:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3357c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2360:x1874702464192256:12345-192.168.201.38@tcp:400: Request processed in 5581us (5852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855734.713594:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00080000:0.0:1787855734.713684:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787855734.713692:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787855734.714455:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2360:x1874702464192000:12345-192.168.201.38@tcp:400: Request processed in 6124us (6821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855734.714586:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 127 00000100:00100000:2.0:1787855734.719376:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464192128 00000100:00100000:2.0:1787855734.719399:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464192128 00000100:00100000:2.0:1787855734.719509:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:2.0:1787855734.719524:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c33570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464192128:12345-192.168.201.38@tcp:400: 00000100:00100000:2.0:1787855734.719828:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c33570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464192128:12345-192.168.201.38@tcp:400: Request processed in 307us (12084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855734.719837:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00080000:2.0:1787855734.719877:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855734.722255:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2360:x1874702464192384:12345-192.168.201.38@tcp:400: Request processed in 13819us (14469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855734.722272:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:1.0:1787855734.909061:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486232704:0@lo:13: 00000100:00100000:1.0:1787855734.909142:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855734.909310:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486232704 00000100:00100000:0.0:1787855734.909318:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486232704 00000100:00100000:0.0:1787855734.909378:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787855734.909387:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc2570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486232704:12345-0@lo:13: 00002000:00000024:0.0:1787855734.909418:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855734.909458:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc2570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486232704:12345-0@lo:13: Request processed in 73us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855734.909465:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787855734.909615:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787855734.909641:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a72c3354f00 x1874702486232704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855734.909657:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486232704:0@lo:13: 00000001:02000400:1.0:1787855735.345256:0:8281:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1787855735.421383:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486232960:0@lo:400: 00000100:00100000:0.0:1787855735.421468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855735.421697:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486233472:0@lo:400: 00000100:00100000:0.0:1787855735.421735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855735.421765:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787855735.421771:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486232832:0@lo:400: 00000100:00100000:0.0:1787855735.421886:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855735.421910:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486233344:0@lo:400: 00000100:00100000:0.0:1787855735.421930:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855735.421954:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486233088:0@lo:400: 00000100:00100000:0.0:1787855735.421975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855735.421993:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787855735.421998:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486233216:0@lo:400: 00000100:00100000:0.0:1787855735.422017:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855735.422041:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486233472 00000100:00100000:0.0:1787855735.422047:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486233472 00000100:00100000:0.0:1787855735.422092:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486233216 00000100:00100000:1.0:1787855735.422206:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486232960 00000100:00100000:1.0:1787855735.422209:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486232960 00000100:00100000:1.0:1787855735.422229:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486233344 00000100:00100000:1.0:1787855735.422231:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486233344 00000100:00100000:1.0:1787855735.422241:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486233088 00000100:00100000:1.0:1787855735.422243:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486233088 00000100:00100000:1.0:1787855735.422256:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787855735.422263:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486232960:12345-0@lo:400: 00000100:00100000:1.0:1787855735.422323:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486232960:12345-0@lo:400: Request processed in 59us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855735.422329:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787855735.422345:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787855735.422350:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486233344:12345-0@lo:400: 00000100:00100000:1.0:1787855735.422372:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486233344:12345-0@lo:400: Request processed in 22us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855735.422387:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787855735.422398:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787855735.422403:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486233088:12345-0@lo:400: 00000100:00100000:1.0:1787855735.422605:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486233088:12345-0@lo:400: Request processed in 201us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855735.422612:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787855735.422629:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787855735.422634:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787855735.422659:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486233088:0@lo:400: 00000100:00100000:1.0:1787855735.422691:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486233344:0@lo:400: 00000100:00100000:1.0:1787855735.422712:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486232960:0@lo:400: 00000100:00100000:0.0:1787855735.423572:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486233216 00000100:00100000:0.0:1787855735.423617:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787855735.423625:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486233472:12345-0@lo:400: 00000100:00100000:0.0:1787855735.423680:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486233472:12345-0@lo:400: Request processed in 56us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855735.423687:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787855735.423711:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787855735.423717:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486233216:12345-0@lo:400: 00000100:00100000:0.0:1787855735.423750:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486233216:12345-0@lo:400: Request processed in 33us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855735.423764:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787855735.423890:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486232832 00000100:00100000:1.0:1787855735.423896:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486232832 00000100:00100000:1.0:1787855735.423928:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787855735.423934:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c446b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486232832:12345-0@lo:400: 00000100:00100000:1.0:1787855735.423966:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c446b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486232832:12345-0@lo:400: Request processed in 33us (2080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855735.423972:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00080000:1.0:1787855735.424026:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a72c3354f00 x1874702486233216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855735.424040:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486233216:0@lo:400: 00000100:00100000:1.0:1787855735.424071:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486232832:0@lo:400: 00010000:00080000:1.0:1787855735.424083:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73fa0a3480 x1874702486233472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855735.424366:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486233472:0@lo:400: 00010000:00010000:0.0:1787855735.549950:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855735.932158:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787855735.932184:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc254f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486233600:0@lo:13: 00000100:00100000:2.0:1787855735.932256:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855735.934077:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486233600 00000100:00100000:1.0:1787855735.934091:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486233600 00000100:00100000:1.0:1787855735.934153:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787855735.934165:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486233600:12345-0@lo:13: 00002000:00000024:1.0:1787855735.934202:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787855735.934274:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486233600:12345-0@lo:13: Request processed in 112us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855735.934282:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787855735.934307:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73cc254f00 x1874702486233600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855735.934328:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc254f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486233600:0@lo:13: 00010000:00010000:1.0:1787855736.573171:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855737.597281:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855738.626360:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787855739.185279:0:8430:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9bc18570 20000000:00000080:3.0:1787855739.185296:0:8430:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a72c308f800 uarg=0000000000000000 20000000:01000000:3.0:1787855739.185337:0:8430:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787855739.185340:0:8430:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787855739.185343:0:8430:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787855739.185347:0:8430:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787855739.185352:0:8430:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787855739.185366:0:8430:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787855739.185369:0:8430:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787855739.191044:0:8430:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787855739.191052:0:8430:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787855739.195049:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1787855739.198213:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1787855739.198267:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1787855739.198321:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1787855739.198337:0:8430:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787855739.198340:0:8430:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787855739.199428:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787855739.200218:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787855739.200287:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787855739.200325:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1787855739.200340:0:8430:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787855739.200342:0:8430:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787855739.205989:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1787855739.206528:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1787855739.206591:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1787855739.206631:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1787855739.206658:0:8430:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787855739.206661:0:8430:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787855739.207745:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1787855739.208277:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1787855739.208321:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1787855739.208351:0:8430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:2.0:1787855739.208367:0:8430:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787855739.208386:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a7402047200/0x516929ca3366d5d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.208404:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a7402047800/0x516929ca3366d4d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d4cb expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.208412:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a7402046c00/0x516929ca3366d4fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d4f5 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.208419:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d51f expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.208426:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c166c000/0x516929ca3366d534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d52d expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.208433:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c5142200/0x516929ca3366d542 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d53b expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.208440:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a7402173a00/0x516929ca3366d55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d557 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.208470:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c166d600/0x516929ca3366d588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d581 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.208479:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c5143200/0x516929ca3366d596 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169bf expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.208486:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c5143400/0x516929ca3366d59d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169c6 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.208494:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a7402047200/0x516929ca3366d5d5 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.208532:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c5143400/0x516929ca3366d59d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169c6 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.208549:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a73c5143400/0x516929ca3366d59d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169c6 expref: 9 pid: 5827 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855739.208565:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6f61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486233728:192.168.201.38@tcp:104: 00010000:00010000:2.0:1787855739.208679:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c5143200/0x516929ca3366d596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169bf expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.208687:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a73c5143200/0x516929ca3366d596 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169bf expref: 9 pid: 5827 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855739.208695:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6f70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486233856:192.168.201.38@tcp:104: 00010000:00010000:2.0:1787855739.208724:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c166d600/0x516929ca3366d588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d581 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.208752:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a73c166d600/0x516929ca3366d588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d581 expref: 18 pid: 5828 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855739.208761:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6f7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486233984:0@lo:104: 00000100:00100000:2.0:1787855739.208833:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787855739.208884:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a7402173a00/0x516929ca3366d55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d557 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.208891:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a7402173a00/0x516929ca3366d55e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d557 expref: 18 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855739.208898:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0952c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486234112:0@lo:104: 00000100:00100000:2.0:1787855739.208922:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855739.208957:0:7617:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787855739.208968:0:7617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486233984 00000100:00100000:2.0:1787855739.208973:0:7617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486233984 00000100:00100000:2.0:1787855739.209013:0:7617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486234112 00000100:00100000:2.0:1787855739.209016:0:7617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486234112 00000100:00100000:2.0:1787855739.209031:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787855739.209039:0:7617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+4:8430:x1874702486233984:12345-0@lo:104: 00010000:00010000:2.0:1787855739.209050:0:7617:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73c5142c00/0x516929ca3366d581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d588 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209093:0:7617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787855739.209098:0:7617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+4:8430:x1874702486233984:12345-0@lo:104: Request processed in 60us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855739.209104:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787855739.209122:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787855739.209135:0:7617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa5a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:8430:x1874702486234112:12345-0@lo:104: 00010000:00010000:2.0:1787855739.209142:0:7617:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73c166d400/0x516929ca3366d557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d55e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209171:0:7617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787855739.209176:0:7617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa5a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:8430:x1874702486234112:12345-0@lo:104: Request processed in 43us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855739.209181:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1787855739.209225:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787855739.209231:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c5142c00/0x516929ca3366d581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d588 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209237:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142c00 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:2.0:1787855739.209241:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5142c00/0x516929ca3366d581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d588 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209248:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c5142c00/0x516929ca3366d581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d588 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787855739.209255:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5142c00/0x516929ca3366d581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d588 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855739.209259:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787855739.209282:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c5142c00/0x516929ca3366d581 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d588 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209288:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787855739.209305:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c5142c00/0x516929ca3366d581 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d588 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209322:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c5142c00/0x516929ca3366d581 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d588 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209333:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855739.209336:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c166d400/0x516929ca3366d557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d55e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209341:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166d400 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:2.0:1787855739.209344:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c166d400/0x516929ca3366d557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d55e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209349:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c166d400/0x516929ca3366d557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d55e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787855739.209355:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c166d400/0x516929ca3366d557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d55e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855739.209360:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787855739.209372:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c166d400/0x516929ca3366d557 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d55e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209378:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787855739.209388:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c166d400/0x516929ca3366d557 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d55e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209394:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c166d400/0x516929ca3366d557 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d55e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209404:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855739.209411:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855739.209413:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855739.209426:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486234240:0@lo:103: 00000100:00100000:2.0:1787855739.209454:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855739.209492:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486234240 00000100:00100000:2.0:1787855739.209495:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486234240 00010000:00010000:2.0:1787855739.209512:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c166d600/0x516929ca3366d588 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d581 expref: 19 pid: 5828 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855739.209531:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787855739.209537:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa096d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486234240:12345-0@lo:103: 00010000:00010000:2.0:1787855739.209546:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855739.209551:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c166d600/0x516929ca3366d588 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d581 expref: 19 pid: 5828 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209559:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c166d600/0x516929ca3366d588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d581 expref: 19 pid: 5828 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209573:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855739.209597:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa096d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486234240:12345-0@lo:103: Request processed in 60us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855739.209603:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787855739.209647:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486234240:0@lo:103: 00010000:00010000:2.0:1787855739.209677:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c5142200/0x516929ca3366d542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d53b expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209685:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a73c5142200/0x516929ca3366d542 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d53b expref: 18 pid: 5827 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855739.209693:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0943c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486234496:0@lo:104: 00000100:00100000:2.0:1787855739.209719:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855739.209737:0:7617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486234496 00000100:00100000:2.0:1787855739.209740:0:7617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486234496 00000100:00100000:2.0:1787855739.209760:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787855739.209767:0:7617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa097840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:8430:x1874702486234496:12345-0@lo:104: 00010000:00010000:2.0:1787855739.209798:0:7617:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73c166c600/0x516929ca3366d53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d542 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209830:0:7617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787855739.209835:0:7617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa097840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:8430:x1874702486234496:12345-0@lo:104: Request processed in 69us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855739.209840:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787855739.209856:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855739.209860:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c166c600/0x516929ca3366d53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d542 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209866:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166c600 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:2.0:1787855739.209870:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c166c600/0x516929ca3366d53b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d542 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209877:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c166c600/0x516929ca3366d53b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d542 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787855739.209882:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c166c600/0x516929ca3366d53b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d542 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855739.209887:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787855739.209902:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c166c600/0x516929ca3366d53b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d542 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209917:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787855739.209923:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c166c600/0x516929ca3366d53b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d542 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209929:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c166c600/0x516929ca3366d53b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d542 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209938:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855739.209940:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855739.209941:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855739.209957:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c166c000/0x516929ca3366d534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d52d expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.209965:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a73c166c000/0x516929ca3366d534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d52d expref: 18 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855739.209973:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa094f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486234752:0@lo:104: 00000100:00100000:2.0:1787855739.209995:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855739.210013:0:7617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486234752 00000100:00100000:2.0:1787855739.210016:0:7617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486234752 00000100:00100000:2.0:1787855739.210037:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787855739.210042:0:7617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:8430:x1874702486234752:12345-0@lo:104: 00010000:00010000:2.0:1787855739.210049:0:7617:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d534 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210079:0:7617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787855739.210083:0:7617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:8430:x1874702486234752:12345-0@lo:104: Request processed in 41us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855739.210095:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1787855739.210108:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855739.210112:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d534 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210118:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402047600 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:2.0:1787855739.210122:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d534 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210129:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d534 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787855739.210135:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d534 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855739.210140:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787855739.210153:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d52d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d534 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210159:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787855739.210168:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d52d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d534 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210174:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d52d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d534 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210183:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855739.210185:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855739.210187:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855739.210194:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa096580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486234880:0@lo:103: 00000100:00100000:2.0:1787855739.210224:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855739.210253:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486234880 00000100:00100000:2.0:1787855739.210257:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486234880 00010000:00010000:2.0:1787855739.210271:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c166c000/0x516929ca3366d534 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d52d expref: 19 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855739.210291:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787855739.210298:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa095a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3306:x1874702486234880:12345-0@lo:103: 00010000:00010000:2.0:1787855739.210305:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855739.210310:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c166c000/0x516929ca3366d534 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d52d expref: 19 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210318:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c166c000/0x516929ca3366d534 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d52d expref: 19 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210328:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855739.210352:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa095a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3306:x1874702486234880:12345-0@lo:103: Request processed in 55us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855739.210358:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787855739.210383:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa096580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486234880:0@lo:103: 00010000:00010000:2.0:1787855739.210409:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d51f expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210418:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d526 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d51f expref: 18 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855739.210426:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa096580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486235008:0@lo:104: 00000100:00100000:2.0:1787855739.210445:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855739.210461:0:7617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486235008 00000100:00100000:2.0:1787855739.210470:0:7617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486235008 00000100:00100000:2.0:1787855739.210491:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787855739.210498:0:7617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:8430:x1874702486235008:12345-0@lo:104: 00010000:00010000:2.0:1787855739.210505:0:7617:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73c5143800/0x516929ca3366d51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d526 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210535:0:7617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787855739.210540:0:7617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:8430:x1874702486235008:12345-0@lo:104: Request processed in 44us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855739.210546:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1787855739.210559:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855739.210563:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c5143800/0x516929ca3366d51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d526 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210569:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143800 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:2.0:1787855739.210572:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5143800/0x516929ca3366d51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d526 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210579:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c5143800/0x516929ca3366d51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d526 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787855739.210586:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5143800/0x516929ca3366d51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d526 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855739.210591:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787855739.210606:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c5143800/0x516929ca3366d51f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d526 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210611:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787855739.210621:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c5143800/0x516929ca3366d51f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d526 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210645:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c5143800/0x516929ca3366d51f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d526 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210657:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855739.210658:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855739.210660:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855739.210668:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486235136:0@lo:103: 00000100:00100000:2.0:1787855739.210691:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855739.210715:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486235136 00000100:00100000:2.0:1787855739.210719:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486235136 00010000:00010000:2.0:1787855739.210731:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d526 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d51f expref: 19 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855739.210748:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787855739.210753:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa094780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486235136:12345-0@lo:103: 00010000:00010000:2.0:1787855739.210760:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855739.210765:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d526 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d51f expref: 19 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210797:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d526 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d51f expref: 19 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210808:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855739.210834:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa094780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486235136:12345-0@lo:103: Request processed in 80us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855739.210840:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787855739.210867:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486235136:0@lo:103: 00010000:00010000:2.0:1787855739.210903:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a7402046c00/0x516929ca3366d4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d4f5 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.210913:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a7402046c00/0x516929ca3366d4fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d4f5 expref: 18 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855739.210922:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa097480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486235264:0@lo:104: 00000100:00100000:2.0:1787855739.210943:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855739.210962:0:7617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486235264 00000100:00100000:2.0:1787855739.210966:0:7617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486235264 00000100:00100000:2.0:1787855739.210986:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787855739.210991:0:7617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa095680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:8430:x1874702486235264:12345-0@lo:104: 00010000:00010000:2.0:1787855739.210998:0:7617:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73c5142800/0x516929ca3366d4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d4fc expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.211028:0:7617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787855739.211033:0:7617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa095680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:8430:x1874702486235264:12345-0@lo:104: Request processed in 42us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855739.211038:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1787855739.211053:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855739.211057:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c5142800/0x516929ca3366d4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d4fc expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.211063:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142800 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:2.0:1787855739.211066:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5142800/0x516929ca3366d4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d4fc expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.211072:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c5142800/0x516929ca3366d4f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d4fc expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787855739.211086:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5142800/0x516929ca3366d4f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d4fc expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855739.211091:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787855739.211104:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c5142800/0x516929ca3366d4f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d4fc expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.211110:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787855739.211116:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c5142800/0x516929ca3366d4f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d4fc expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.211122:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c5142800/0x516929ca3366d4f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d4fc expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.211132:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855739.211134:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855739.211136:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855739.211153:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a7402047800/0x516929ca3366d4d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d4cb expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.211161:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a7402047800/0x516929ca3366d4d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d4cb expref: 18 pid: 5828 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855739.211171:0:8430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa094b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486235520:0@lo:104: 00000100:00100000:2.0:1787855739.211192:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855739.211212:0:7617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486235520 00000100:00100000:2.0:1787855739.211215:0:7617:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486235520 00000100:00100000:2.0:1787855739.211235:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787855739.211240:0:7617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa096940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:8430:x1874702486235520:12345-0@lo:104: 00010000:00010000:2.0:1787855739.211254:0:7617:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a7402173400/0x516929ca3366d4cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d4d2 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.211283:0:7617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787855739.211288:0:7617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa096940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:8430:x1874702486235520:12345-0@lo:104: Request processed in 48us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855739.211293:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787855739.211307:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855739.211311:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402173400/0x516929ca3366d4cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d4d2 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.211316:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402173400 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:2.0:1787855739.211319:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402173400/0x516929ca3366d4cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d4d2 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.211326:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402173400/0x516929ca3366d4cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d4d2 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787855739.211333:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402173400/0x516929ca3366d4cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d4d2 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855739.211337:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787855739.211350:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402173400/0x516929ca3366d4cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d4d2 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.211356:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787855739.211360:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402173400/0x516929ca3366d4cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d4d2 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.211366:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402173400/0x516929ca3366d4cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d4d2 expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.211385:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855739.211386:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855739.211388:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855739.211398:0:8430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c60ae3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787855739.211413:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c166d600/0x516929ca3366d588 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d581 expref: 18 pid: 5828 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855739.211424:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6f7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486233984:0@lo:104: 00000100:00100000:2.0:1787855739.211434:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0952c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486234112:0@lo:104: 00000100:00100000:2.0:1787855739.211442:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0943c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486234496:0@lo:104: 00010000:00010000:2.0:1787855739.211449:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c166c000/0x516929ca3366d534 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d52d expref: 17 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855739.211457:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa094f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486234752:0@lo:104: 00010000:00010000:2.0:1787855739.211465:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d526 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d51f expref: 16 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855739.211471:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa096580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486235008:0@lo:104: 00000100:00100000:2.0:1787855739.211477:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa097480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486235264:0@lo:104: 00000100:00100000:2.0:1787855739.211482:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa094b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486235520:0@lo:104: 00010000:00010000:1.0:1787855739.211899:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855739.211912:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa097c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486234368:0@lo:103: 00000100:00100000:1.0:1787855739.211942:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855739.211968:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa095e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486235392:0@lo:103: 00000100:00100000:1.0:1787855739.211986:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855739.212004:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787855739.212009:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486234624:0@lo:103: 00000100:00100000:1.0:1787855739.212028:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855739.212043:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486235648:0@lo:103: 00000100:00100000:1.0:1787855739.212063:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855739.212090:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486234368 00000100:00100000:1.0:1787855739.212094:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486234368 00010000:00010000:1.0:1787855739.212114:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a7402173a00/0x516929ca3366d55e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d557 expref: 16 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855739.212139:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486235392 00000100:00100000:1.0:1787855739.212142:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486235392 00010000:00010000:1.0:1787855739.212154:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a7402046c00/0x516929ca3366d4fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d4f5 expref: 17 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855739.212163:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486234624 00000100:00100000:1.0:1787855739.212166:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486234624 00010000:00010000:1.0:1787855739.212175:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c5142200/0x516929ca3366d542 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d53b expref: 18 pid: 5827 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855739.212184:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486235648 00000100:00100000:1.0:1787855739.212186:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486235648 00010000:00010000:1.0:1787855739.212195:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a7402047800/0x516929ca3366d4d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d4cb expref: 19 pid: 5828 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855739.212206:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787855739.212212:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc256940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486234368:12345-0@lo:103: 00010000:00010000:1.0:1787855739.212221:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855739.212226:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a7402173a00/0x516929ca3366d55e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d557 expref: 19 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855739.212234:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a7402173a00/0x516929ca3366d55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d557 expref: 19 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855739.212247:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402173a00/0x516929ca3366d55e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d557 expref: 19 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855739.212258:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855739.212286:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc256940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:3304:x1874702486234368:12345-0@lo:103: Request processed in 74us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855739.212301:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787855739.212317:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787855739.212322:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc254f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:3304:x1874702486235392:12345-0@lo:103: 00010000:00010000:1.0:1787855739.212329:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855739.212333:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a7402046c00/0x516929ca3366d4fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d4f5 expref: 17 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855739.212341:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a7402046c00/0x516929ca3366d4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d4f5 expref: 17 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855739.212351:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402046c00/0x516929ca3366d4fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d4f5 expref: 17 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855739.212360:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855739.212381:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc254f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:3304:x1874702486235392:12345-0@lo:103: Request processed in 59us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855739.212387:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787855739.212400:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787855739.212406:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc255680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:3304:x1874702486234624:12345-0@lo:103: 00010000:00010000:1.0:1787855739.212414:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855739.212418:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c5142200/0x516929ca3366d542 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d53b expref: 15 pid: 5827 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855739.212426:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c5142200/0x516929ca3366d542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d53b expref: 15 pid: 5827 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855739.212436:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c5142200/0x516929ca3366d542 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d53b expref: 15 pid: 5827 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855739.212454:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855739.212476:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc255680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:3304:x1874702486234624:12345-0@lo:103: Request processed in 70us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855739.212482:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787855739.212495:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787855739.212502:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c53d8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:3304:x1874702486235648:12345-0@lo:103: 00010000:00010000:1.0:1787855739.212510:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855739.212514:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a7402047800/0x516929ca3366d4d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d4cb expref: 13 pid: 5828 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855739.212522:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a7402047800/0x516929ca3366d4d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d4cb expref: 13 pid: 5828 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855739.212532:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402047800/0x516929ca3366d4d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d4cb expref: 13 pid: 5828 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855739.212540:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855739.212559:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c53d8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:3304:x1874702486235648:12345-0@lo:103: Request processed in 58us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855739.212565:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787855739.212651:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486234624:0@lo:103: 00000100:00100000:1.0:1787855739.212661:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486235648:0@lo:103: 00000100:00100000:1.0:1787855739.212669:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa097c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486234368:0@lo:103: 00000100:00100000:1.0:1787855739.212676:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa095e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486235392:0@lo:103: 00000100:00100000:0.0:1787855739.240766:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855739.240856:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855739.240944:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464192512 00000100:00100000:3.0:1787855739.240960:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464192512 00000100:00100000:1.0:1787855739.240967:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464192640 00000100:00100000:1.0:1787855739.240993:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464192640 00010000:00010000:3.0:1787855739.241020:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c5143400/0x516929ca3366d59d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169c6 expref: 11 pid: 5827 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855739.241035:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c5143200/0x516929ca3366d596 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169bf expref: 11 pid: 5827 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855739.241083:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:3.0:1787855739.241107:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:2357:x1874702464192512:12345-192.168.201.38@tcp:103: 00000100:00100000:1.0:1787855739.241107:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:1.0:1787855739.241133:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:2357:x1874702464192640:12345-192.168.201.38@tcp:103: 00010000:00010000:3.0:1787855739.241138:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855739.241149:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c5143400/0x516929ca3366d59d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169c6 expref: 11 pid: 5827 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855739.241150:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855739.241166:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c5143200/0x516929ca3366d596 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169bf expref: 11 pid: 5827 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855739.241178:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c5143400/0x516929ca3366d59d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169c6 expref: 11 pid: 5827 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855739.241329:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6f61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486233728:192.168.201.38@tcp:104: 00000100:00100000:2.0:1787855739.241342:0:8430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6f70c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8430:1874702486233856:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855739.248890:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c5143200/0x516929ca3366d596 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169bf expref: 11 pid: 5827 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855739.248921:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c5143200/0x516929ca3366d596 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169bf expref: 11 pid: 5827 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855739.248939:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855739.249016:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2357:x1874702464192640:12345-192.168.201.38@tcp:103: Request processed in 7890us (8159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855739.249027:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00010000:00010000:3.0:1787855739.255897:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c5143400/0x516929ca3366d59d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169c6 expref: 9 pid: 5827 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855739.255934:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a7402047200/0x516929ca3366d5d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855739.255945:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402047200/0x516929ca3366d5d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855739.256086:0:7616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a7402047200/0x516929ca3366d5d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855739.256107:0:7616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a7402047200/0x516929ca3366d5d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855739.256115:0:7616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a7402047200/0x516929ca3366d5d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855739.256123:0:7616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a7402047200/0x516929ca3366d5d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855739.256132:0:7616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402047200 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855739.256137:0:7616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a7402047200/0x516929ca3366d5d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855739.256147:0:7616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a7402047200/0x516929ca3366d5d5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855739.256159:0:7616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a7402047200/0x516929ca3366d5d5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855739.256174:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855739.256284:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d78451b-7acd-4478-9bc5-3a00d72e2604+8:2357:x1874702464192512:12345-192.168.201.38@tcp:103: Request processed in 15186us (15525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855739.256297:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00010000:00010000:2.0:1787855739.266823:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a7402047200/0x516929ca3366d5d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.266845:0:8430:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a7402047200/0x516929ca3366d5d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.266872:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a7402047200/0x516929ca3366d5d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.266881:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402047200/0x516929ca3366d5d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855739.644076:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855739.817876:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855739.817918:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855739.817962:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855739.818119:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464192896 00000100:00100000:1.0:1787855739.818136:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464192896 00000100:00100000:1.0:1787855739.818236:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464193024 00000100:00100000:1.0:1787855739.818240:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464193024 00000100:00100000:1.0:1787855739.818285:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:1.0:1787855739.818297:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2359:x1874702464192896:12345-192.168.201.38@tcp:400: 00000100:00100000:3.0:1787855739.818305:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464192768 00000100:00100000:3.0:1787855739.818317:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464192768 00000100:00100000:1.0:1787855739.818406:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2359:x1874702464192896:12345-192.168.201.38@tcp:400: Request processed in 110us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855739.818408:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:1.0:1787855739.818424:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:3.0:1787855739.818431:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2359:x1874702464192768:12345-192.168.201.38@tcp:400: 00000100:00100000:3.0:1787855739.818499:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2359:x1874702464192768:12345-192.168.201.38@tcp:400: Request processed in 76us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855739.818506:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00080000:0.0:1787855739.818549:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787855739.818558:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787855739.818563:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787855739.824442:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:2.0:1787855739.824476:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2359:x1874702464193024:12345-192.168.201.38@tcp:400: 00000100:00100000:2.0:1787855739.824558:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2359:x1874702464193024:12345-192.168.201.38@tcp:400: Request processed in 102us (6596us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855739.824567:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:1.0:1787855740.011851:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855740.012222:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464193152 00000100:00100000:2.0:1787855740.012235:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464193152 00000100:00100000:2.0:1787855740.012308:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 129 00000100:00100000:2.0:1787855740.012322:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c446a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+8:5598:x1874702464193152:12345-192.168.201.38@tcp:101: 00010000:00010000:2.0:1787855740.012347:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855740.012373:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402046400/0x516929ca3366d5dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616a28 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855740.012408:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402046400/0x516929ca3366d5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a28 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855740.012420:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402046400/0x516929ca3366d5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a28 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855740.012430:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402046400, rc 0) 00000100:00100000:2.0:1787855740.012526:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c446a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+9:5598:x1874702464193152:12345-192.168.201.38@tcp:101: Request processed in 206us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855740.012535:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 129 00000100:00100000:2.0:1787855740.018495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855740.019017:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464193280 00000100:00100000:1.0:1787855740.019028:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464193280 00000100:00100000:1.0:1787855740.019138:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 130 00000100:00100000:1.0:1787855740.019149:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+9:5598:x1874702464193280:12345-192.168.201.38@tcp:501: 00000100:00100000:1.0:1787855740.019457:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+9:5598:x1874702464193280:12345-192.168.201.38@tcp:501: Request processed in 309us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855740.019467:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 130 00000100:00100000:0.0:1787855740.023995:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855740.027259:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464193408 00000100:00100000:2.0:1787855740.027275:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464193408 00000100:00100000:3.0:1787855740.027761:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 131 00000100:00100000:3.0:1787855740.027817:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+9:5598:x1874702464193408:12345-192.168.201.38@tcp:503: 00000100:00100000:3.0:1787855740.028138:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+9:5598:x1874702464193408:12345-192.168.201.38@tcp:503: Request processed in 362us (4159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855740.028147:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 131 00000100:00100000:3.0:1787855740.036899:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855740.040509:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464193536 00000100:00100000:1.0:1787855740.040526:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464193536 00000100:00100000:2.0:1787855740.040702:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787855740.040723:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486235776:0@lo:13: 00000100:00100000:2.0:1787855740.040822:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855740.041306:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486235776 00000100:00100000:2.0:1787855740.041311:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486235776 00000100:00100000:3.0:1787855740.041438:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787855740.041448:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486235776:12345-0@lo:13: 00002000:00000024:3.0:1787855740.041484:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855740.041535:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486235776:12345-0@lo:13: Request processed in 88us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855740.041542:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787855740.041582:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73cb7a5a40 x1874702486235776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855740.041600:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486235776:0@lo:13: 00000100:00100000:0.0:1787855740.041703:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 132 00000100:00100000:0.0:1787855740.041722:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+9:6065:x1874702464193536:12345-192.168.201.38@tcp:502: 00000100:00100000:0.0:1787855740.042257:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+9:6065:x1874702464193536:12345-192.168.201.38@tcp:502: Request processed in 544us (5366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855740.042265:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 132 00000100:00080000:2.0:1787855740.043689:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787855740.049377:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855740.049691:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464193664 00000100:00100000:3.0:1787855740.049701:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464193664 00000100:00100000:3.0:1787855740.050014:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 133 00000100:00100000:3.0:1787855740.050026:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+9:6065:x1874702464193664:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787855740.050347:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+9:6065:x1874702464193664:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 322us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855740.050356:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 133 00000100:00100000:3.0:1787855740.065017:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855740.065136:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464193792 00000100:00100000:2.0:1787855740.065146:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464193792 00000100:00100000:2.0:1787855740.065229:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 134 00000100:00100000:2.0:1787855740.065239:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c446b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+9:5598:x1874702464193792:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787855740.065255:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855740.065273:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402047e00/0x516929ca3366d5e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616a2f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855740.065301:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402047e00/0x516929ca3366d5e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a2f expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855740.065312:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402047e00/0x516929ca3366d5e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a2f expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855740.065321:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402047e00, rc 0) 00000100:00100000:2.0:1787855740.065418:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c446b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5598:x1874702464193792:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 180us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855740.065438:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 134 00000100:00100000:0.0:1787855740.073095:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855740.073226:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464193920 00000100:00100000:1.0:1787855740.073236:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464193920 00000100:00100000:1.0:1787855740.073289:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 135 00000100:00100000:1.0:1787855740.073299:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c446a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5598:x1874702464193920:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787855740.073647:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c446a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5598:x1874702464193920:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 347us (559us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787855740.073656:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 135 00000100:00100000:2.0:1787855740.540379:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9280f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486235904:0@lo:400: 00000100:00100000:2.0:1787855740.540451:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855740.540508:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486236416:0@lo:400: 00000100:00100000:2.0:1787855740.540534:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855740.540560:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787855740.540566:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9281a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486236288:0@lo:400: 00000100:00100000:2.0:1787855740.540601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855740.540647:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486236288 00000100:00100000:2.0:1787855740.540655:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486236288 00000100:00100000:2.0:1787855740.540698:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787855740.540719:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486236288:12345-0@lo:400: 00000100:00100000:2.0:1787855740.540797:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486236288:12345-0@lo:400: Request processed in 91us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855740.540805:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787855740.540841:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73c9281a40 x1874702486236288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855740.540855:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9281a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486236288:0@lo:400: 00000100:00100000:3.0:1787855740.541055:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486235904 00000100:00100000:3.0:1787855740.541061:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486235904 00000100:00100000:3.0:1787855740.541100:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787855740.541107:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:3307:x1874702486235904:12345-0@lo:400: 00000100:00100000:3.0:1787855740.541146:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:3307:x1874702486235904:12345-0@lo:400: Request processed in 41us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855740.541152:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787855740.541417:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9280f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486235904:0@lo:400: 00000100:00100000:1.0:1787855740.541527:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486236032:0@lo:400: 00000100:00100000:1.0:1787855740.541563:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855740.541603:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486236544:0@lo:400: 00000100:00100000:1.0:1787855740.541634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855740.541660:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787855740.541666:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486236160:0@lo:400: 00000100:00100000:1.0:1787855740.541686:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855740.541803:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486236544 00000100:00100000:0.0:1787855740.541809:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486236544 00000100:00100000:0.0:1787855740.541851:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787855740.541859:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc254f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486236544:12345-0@lo:400: 00000100:00100000:0.0:1787855740.541895:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc254f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486236544:12345-0@lo:400: Request processed in 38us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855740.541901:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787855740.541917:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787855740.542200:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73c9283480 x1874702486236544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855740.542231:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486236544:0@lo:400: 00000100:00100000:2.0:1787855740.544145:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486236416 00000100:00100000:2.0:1787855740.544159:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486236416 00000100:00100000:2.0:1787855740.544226:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486236032 00000100:00100000:2.0:1787855740.544229:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486236032 00000100:00100000:2.0:1787855740.544243:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486236160 00000100:00100000:2.0:1787855740.544245:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486236160 00000100:00100000:2.0:1787855740.544264:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787855740.544286:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486236416:12345-0@lo:400: 00000100:00100000:2.0:1787855740.544384:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486236416:12345-0@lo:400: Request processed in 100us (3848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855740.544392:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787855740.544410:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787855740.544416:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc256940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486236032:12345-0@lo:400: 00000100:00100000:2.0:1787855740.544451:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc256940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486236032:12345-0@lo:400: Request processed in 36us (2887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855740.544456:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787855740.544467:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787855740.544473:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc255680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486236160:12345-0@lo:400: 00000100:00100000:2.0:1787855740.544501:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc255680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486236160:12345-0@lo:400: Request processed in 28us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855740.544506:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787855740.544551:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486236416:0@lo:400: 00000100:00080000:1.0:1787855740.544728:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855740.544754:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486236160:0@lo:400: 00000100:00100000:1.0:1787855740.544796:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486236032:0@lo:400: 00010000:00010000:2.0:1787855740.670160:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787855740.987912:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787855740.987922:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a73e762a800 from 39 10000000:01000000:3.0:1787855740.987928:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787855740.987976:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855740.987988:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855740.987998:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855740.988020:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9280000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486236672:0@lo:101: 00000100:00100000:3.0:1787855740.988087:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855740.988137:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787855740.988243:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486236672 00000100:00100000:1.0:1787855740.988251:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486236672 00000100:00100000:1.0:1787855740.988293:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787855740.988302:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+12:5830:x1874702486236672:12345-0@lo:101: 00010000:00010000:1.0:1787855740.988316:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855740.988328:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c166d400/0x516929ca3366d5f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d5ea expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855740.988351:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c166d400/0x516929ca3366d5f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d5ea expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855740.988362:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c166d400/0x516929ca3366d5f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d5ea expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855740.988371:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166d400, rc 0) 00000100:00100000:1.0:1787855740.988414:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:5830:x1874702486236672:12345-0@lo:101: Request processed in 112us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855740.988420:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787855740.988514:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9280000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486236672:0@lo:101: 00010000:00010000:2.0:1787855740.988529:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d5f1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855740.988538:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d5f1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855740.988613:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7648780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486236800:0@lo:501: 00000100:00100000:2.0:1787855740.988640:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855740.988662:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c24a4300 going to sleep for 11 seconds 00000100:00100000:1.0:1787855740.988721:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486236800 00000100:00100000:1.0:1787855740.988725:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486236800 00000100:00100000:1.0:1787855740.988759:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787855740.988766:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:5830:x1874702486236800:12345-0@lo:501: 00000100:00100000:1.0:1787855740.989012:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:5830:x1874702486236800:12345-0@lo:501: Request processed in 245us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855740.989019:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787855740.989049:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7648780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486236800:0@lo:501: 00000100:00100000:1.0:1787855740.989076:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486236928:0@lo:503: 00000100:00100000:1.0:1787855740.989110:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855740.989129:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e74ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1787855740.989139:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486236928 00000100:00100000:1.0:1787855740.989143:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486236928 00000100:00100000:1.0:1787855740.989157:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787855740.989163:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:5830:x1874702486236928:12345-0@lo:503: 00000100:00100000:1.0:1787855740.989285:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:5830:x1874702486236928:12345-0@lo:503: Request processed in 122us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855740.989292:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787855740.989326:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486236928:0@lo:503: 00000100:00100000:1.0:1787855740.989483:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8457:1874702486237056:0@lo:502: 00000100:00100000:1.0:1787855740.989514:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855740.989531:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486237056 00000100:00100000:1.0:1787855740.989534:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486237056 00000100:00100000:1.0:1787855740.989549:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787855740.989554:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:8457:x1874702486237056:12345-0@lo:502: 00000100:00100000:1.0:1787855740.989704:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:8457:x1874702486237056:12345-0@lo:502: Request processed in 149us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855740.989710:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787855740.989735:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e74acf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787855740.989751:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8457:1874702486237056:0@lo:502: 00000100:00100000:1.0:1787855740.989808:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8457:1874702486237184:0@lo:502: 00000100:00100000:1.0:1787855740.989836:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855740.989854:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486237184 00000100:00100000:1.0:1787855740.989857:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486237184 00000100:00100000:1.0:1787855740.989873:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787855740.989879:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:8457:x1874702486237184:12345-0@lo:502: 00000100:00100000:1.0:1787855740.989995:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:8457:x1874702486237184:12345-0@lo:502: Request processed in 115us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855740.990001:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787855740.990030:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e74acf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787855740.990041:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8457:1874702486237184:0@lo:502: 00000040:00080000:1.0:1787855740.990057:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787855740.990113:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787855740.990129:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787855740.990138:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d5f1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855740.990147:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d5f1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787855740.990155:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787855740.990157:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787855740.990160:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787855740.990179:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855740.990185:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855740.990199:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855740.990210:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486237312:0@lo:101: 00000100:00100000:1.0:1787855740.990234:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855740.990245:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e74acf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787855740.990256:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486237312 00000100:00100000:1.0:1787855740.990259:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486237312 00000100:00100000:1.0:1787855740.990275:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787855740.990280:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+13:5830:x1874702486237312:12345-0@lo:101: 00010000:00010000:1.0:1787855740.990287:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855740.990296:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c166c800/0x516929ca3366d5ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d5f8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855740.990313:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c166c800/0x516929ca3366d5ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d5f8 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855740.990322:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c166c800/0x516929ca3366d5ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d5f8 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855740.990328:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166c800, rc 0) 00000100:00100000:1.0:1787855740.990354:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:5830:x1874702486237312:12345-0@lo:101: Request processed in 73us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855740.990359:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787855740.990386:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486237312:0@lo:101: 00010000:00010000:1.0:1787855740.990396:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d5ff expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855740.990413:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d5ff expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855740.990445:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486237440:0@lo:501: 00000100:00100000:1.0:1787855740.990470:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855740.990482:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e74acf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787855740.990492:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486237440 00000100:00100000:1.0:1787855740.990495:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486237440 00000100:00100000:1.0:1787855740.990509:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787855740.990513:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:5830:x1874702486237440:12345-0@lo:501: 00000100:00100000:1.0:1787855740.990686:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:5830:x1874702486237440:12345-0@lo:501: Request processed in 171us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855740.990692:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787855740.990717:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486237440:0@lo:501: 00000100:00100000:1.0:1787855740.990737:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486237568:0@lo:503: 00000100:00100000:1.0:1787855740.990768:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855740.990810:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e74acf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787855740.990821:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486237568 00000100:00100000:1.0:1787855740.990824:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486237568 00000100:00100000:1.0:1787855740.990840:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787855740.990845:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:5830:x1874702486237568:12345-0@lo:503: 00000100:00100000:1.0:1787855740.990969:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:5830:x1874702486237568:12345-0@lo:503: Request processed in 123us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855740.990974:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787855740.991005:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486237568:0@lo:503: 00000100:00100000:3.0:1787855740.991548:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8458:1874702486237696:0@lo:502: 00000100:00100000:3.0:1787855740.991587:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855740.991618:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a900 going to sleep for 11 seconds 00000100:00100000:2.0:1787855740.991662:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486237696 00000100:00100000:2.0:1787855740.991667:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486237696 00000100:00100000:2.0:1787855740.991709:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787855740.991716:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:8458:x1874702486237696:12345-0@lo:502: 00000100:00100000:2.0:1787855740.991870:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:8458:x1874702486237696:12345-0@lo:502: Request processed in 155us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855740.991876:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787855740.992010:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8458:1874702486237696:0@lo:502: 00000020:01000000:3.0:1787855740.992031:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787855740.992038:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855740.992040:0:8458:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787855740.992046:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787855740.992065:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8458:1874702486237824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855740.992095:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855740.992123:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a900 going to sleep for 11 seconds 00000100:00100000:2.0:1787855740.992265:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486237824 00000100:00100000:2.0:1787855740.992269:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486237824 00000100:00100000:2.0:1787855740.992298:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787855740.992305:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:8458:x1874702486237824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787855740.992410:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:8458:x1874702486237824:12345-0@lo:502:llog_process_th.0 Request processed in 105us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855740.992417:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787855740.992494:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8458:1874702486237824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787855740.992510:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787855740.992515:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855740.992516:0:8458:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787855740.992520:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787855740.992647:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787855740.992672:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787855740.992680:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d5ff expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855740.992690:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d5ff expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855740.992708:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787855740.992711:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a73d0d01000 from 39 10000000:01000000:2.0:1787855740.992714:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787855740.992735:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855740.992743:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855740.992768:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855740.992813:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7649680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486237952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787855740.992842:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855740.992854:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c24a4540 going to sleep for 11 seconds 00000100:00100000:3.0:1787855740.993011:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486237952 00000100:00100000:3.0:1787855740.993015:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486237952 00000100:00100000:3.0:1787855740.993045:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787855740.993051:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:5830:x1874702486237952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855740.993059:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855740.993072:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73d1228400/0x516929ca3366d60d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d606 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855740.993091:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1228400/0x516929ca3366d60d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d606 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855740.993100:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73d1228400/0x516929ca3366d60d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d606 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855740.993118:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228400, rc 0) 00000100:00100000:3.0:1787855740.993148:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486237952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855740.993154:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787855740.993180:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7649680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486237952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855740.993191:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d60d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855740.993199:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d60d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855740.993235:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486238080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855740.993258:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855740.993271:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787855740.993283:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486238080 00000100:00100000:3.0:1787855740.993286:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486238080 00000100:00100000:3.0:1787855740.993303:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787855740.993310:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486238080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855740.993501:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486238080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855740.993508:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787855740.993534:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486238080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855740.993556:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486238208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787855740.993584:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855740.993600:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787855740.993624:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486238208 00000100:00100000:3.0:1787855740.993628:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486238208 00000100:00100000:3.0:1787855740.993647:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787855740.993653:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486238208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787855740.993818:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486238208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855740.993825:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787855740.993857:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486238208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787855740.994003:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8459:1874702486238336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855740.994031:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855740.994048:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486238336 00000100:00100000:3.0:1787855740.994052:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486238336 00000100:00100000:3.0:1787855740.994069:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787855740.994075:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:8459:x1874702486238336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855740.994206:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:8459:x1874702486238336:12345-0@lo:502:llog_process_th.0 Request processed in 131us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855740.994214:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787855740.994237:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787855740.994247:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8459:1874702486238336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855740.994278:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8459:1874702486238464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855740.994304:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855740.994321:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486238464 00000100:00100000:3.0:1787855740.994324:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486238464 00000100:00100000:3.0:1787855740.994343:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787855740.994349:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:8459:x1874702486238464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855740.994460:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:8459:x1874702486238464:12345-0@lo:502:llog_process_th.0 Request processed in 110us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855740.994467:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787855740.994494:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787855740.994504:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8459:1874702486238464:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787855740.994520:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787855740.994559:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787855740.994574:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787855740.994581:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d60d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855740.994589:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d60d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855740.994597:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787855740.994599:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787855740.994614:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787855740.994635:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855740.994642:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855740.994650:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855740.994662:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486238592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787855740.994684:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855740.994701:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787855740.994711:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486238592 00000100:00100000:3.0:1787855740.994714:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486238592 00000100:00100000:3.0:1787855740.994731:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787855740.994736:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:5830:x1874702486238592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855740.994743:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855740.994752:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73d1228200/0x516929ca3366d61b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d614 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855740.994769:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1228200/0x516929ca3366d61b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d614 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855740.994799:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73d1228200/0x516929ca3366d61b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d614 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855740.994808:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228200, rc 0) 00000100:00100000:3.0:1787855740.994833:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486238592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855740.994839:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787855740.994863:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486238592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855740.994873:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d61b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855740.994880:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d61b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855740.994912:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486238720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855740.994932:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855740.994949:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787855740.994959:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486238720 00000100:00100000:3.0:1787855740.994962:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486238720 00000100:00100000:3.0:1787855740.994980:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787855740.994985:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486238720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855740.995138:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486238720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855740.995145:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787855740.995169:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486238720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855740.995191:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486238848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787855740.995220:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855740.995231:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787855740.995241:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486238848 00000100:00100000:3.0:1787855740.995245:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486238848 00000100:00100000:3.0:1787855740.995262:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787855740.995268:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486238848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787855740.995378:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486238848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855740.995385:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787855740.995417:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486238848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787855741.003053:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8460:1874702486238976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855741.003142:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855741.003630:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a480 going to sleep for 11 seconds 00000100:00100000:1.0:1787855741.005625:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486238976 00000100:00100000:1.0:1787855741.005638:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486238976 00000100:00100000:0.0:1787855741.006125:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787855741.006137:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:8460:x1874702486238976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855741.006408:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:8460:x1874702486238976:12345-0@lo:502:llog_process_th.0 Request processed in 273us (3265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855741.006416:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787855741.006650:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8460:1874702486238976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787855741.006686:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787855741.006695:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855741.006698:0:8460:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787855741.006716:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787855741.006761:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8460:1874702486239104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787855741.006832:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855741.006880:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa6ed180 going to sleep for 11 seconds 00000100:00100000:3.0:1787855741.006947:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486239104 00000100:00100000:3.0:1787855741.006952:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486239104 00000100:00100000:3.0:1787855741.006990:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787855741.006997:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:8460:x1874702486239104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855741.007129:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:8460:x1874702486239104:12345-0@lo:502:llog_process_th.0 Request processed in 132us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855741.007137:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787855741.007476:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8460:1874702486239104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787855741.007496:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787855741.007500:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855741.007502:0:8460:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787855741.007505:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1787855741.007663:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787855741.007680:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787855741.007692:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d61b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.007713:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d61b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855741.007724:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787855741.007727:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a73f4b59000 from 39 10000000:01000000:3.0:1787855741.007730:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787855741.007765:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.007800:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.007810:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855741.007826:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486239232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787855741.008130:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855741.008170:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a480 going to sleep for 11 seconds 00000100:00100000:1.0:1787855741.008210:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486239232 00000100:00100000:1.0:1787855741.008215:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486239232 00000100:00100000:1.0:1787855741.008250:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787855741.008266:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486239232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787855741.008276:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855741.008289:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c166dc00/0x516929ca3366d629 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d622 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.008309:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c166dc00/0x516929ca3366d629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d622 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.008319:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c166dc00/0x516929ca3366d629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d622 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.008339:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166dc00, rc 0) 00000100:00100000:1.0:1787855741.008366:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486239232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855741.008372:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787855741.008480:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486239232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855741.008497:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d629 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.008506:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d629 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855741.008546:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486239360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855741.008571:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855741.008591:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787855741.008665:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486239360 00000100:00100000:0.0:1787855741.008669:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486239360 00000100:00100000:0.0:1787855741.008708:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787855741.008716:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486239360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787855741.009194:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486239360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 478us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855741.009206:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787855741.009299:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486239360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855741.009328:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486239488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787855741.009364:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855741.009386:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787855741.009463:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486239488 00000100:00100000:0.0:1787855741.009468:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486239488 00000100:00100000:0.0:1787855741.009496:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787855741.009504:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486239488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787855741.009644:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486239488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855741.009651:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787855741.010188:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486239488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787855741.010530:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8461:1874702486239616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787855741.010576:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855741.010619:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa6ed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855741.010667:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486239616 00000100:00100000:0.0:1787855741.010672:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486239616 00000100:00100000:0.0:1787855741.010742:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787855741.010758:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:8461:x1874702486239616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855741.010975:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:8461:x1874702486239616:12345-0@lo:502:llog_process_th.0 Request processed in 225us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855741.010983:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787855741.011292:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cc2543c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8461:1874702486239616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855741.011334:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8461:1874702486239744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855741.011367:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855741.014910:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a480 going to sleep for 11 seconds 00000100:00100000:1.0:1787855741.015327:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486239744 00000100:00100000:1.0:1787855741.015336:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486239744 00000100:00100000:1.0:1787855741.015386:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787855741.015395:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:8461:x1874702486239744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787855741.015674:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:8461:x1874702486239744:12345-0@lo:502:llog_process_th.0 Request processed in 280us (4305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855741.015681:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787855741.015885:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8461:1874702486239744:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787855741.015919:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787855741.015984:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787855741.016002:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787855741.016012:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d629 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.016033:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d629 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855741.016042:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787855741.016045:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787855741.016047:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787855741.016075:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.016083:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.016091:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855741.016109:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486239872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787855741.016147:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855741.016166:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a480 going to sleep for 11 seconds 00000100:00100000:1.0:1787855741.016469:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486239872 00000100:00100000:1.0:1787855741.016474:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486239872 00000100:00100000:1.0:1787855741.016496:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787855741.016503:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486239872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787855741.016512:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855741.016524:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c166c600/0x516929ca3366d637 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d630 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.016546:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c166c600/0x516929ca3366d637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d630 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.016556:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c166c600/0x516929ca3366d637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d630 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.016571:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166c600, rc 0) 00000100:00100000:1.0:1787855741.016623:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486239872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855741.016630:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787855741.017457:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486239872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855741.017473:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d637 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.017482:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d637 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855741.017532:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486240000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855741.017567:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855741.024650:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787855741.030150:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486240000 00000100:00100000:2.0:1787855741.030165:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486240000 00000100:00100000:1.0:1787855741.031190:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787855741.031267:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c54dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486240000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787855741.031564:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c54dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486240000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 362us (13995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855741.031572:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787855741.031639:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486240000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787855741.031689:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0a30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486240128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787855741.031744:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855741.032067:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6180 going to sleep for 11 seconds 00000100:00100000:0.0:1787855741.032101:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486240128 00000100:00100000:0.0:1787855741.032112:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486240128 00000100:00100000:0.0:1787855741.032141:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787855741.032149:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486240128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787855741.032284:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486240128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855741.032290:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787855741.032328:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0a30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486240128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787855741.042096:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7649e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8463:1874702486240256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787855741.042171:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855741.042209:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c24a4540 going to sleep for 11 seconds 00000100:00100000:0.0:1787855741.042691:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486240256 00000100:00100000:0.0:1787855741.042706:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486240256 00000100:00100000:0.0:1787855741.042761:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787855741.042770:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:8463:x1874702486240256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855741.043161:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:8463:x1874702486240256:12345-0@lo:502:llog_process_th.0 Request processed in 391us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855741.043169:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787855741.048904:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7649e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8463:1874702486240256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787855741.048951:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787855741.048962:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855741.048964:0:8463:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787855741.048971:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787855741.049007:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9283480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8463:1874702486240384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855741.049075:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855741.049122:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a600 going to sleep for 11 seconds 00000100:00100000:0.0:1787855741.049445:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486240384 00000100:00100000:0.0:1787855741.049452:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486240384 00000100:00100000:0.0:1787855741.049511:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787855741.049521:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:8463:x1874702486240384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855741.049761:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:8463:x1874702486240384:12345-0@lo:502:llog_process_th.0 Request processed in 241us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855741.049768:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787855741.050371:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9283480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8463:1874702486240384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787855741.050399:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787855741.050406:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855741.050408:0:8463:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787855741.050413:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787855741.050584:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787855741.050615:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787855741.050626:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d637 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855741.050648:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d637 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855741.050657:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787855741.050660:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a73c44919d0 from 1 10000000:01000000:0.0:1787855741.050662:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787855741.050689:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5142000/0x516929ca3366d63e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855741.050695:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c5142000/0x516929ca3366d63e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855741.050715:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c5142000/0x516929ca3366d63e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855741.050734:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0a30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486240512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787855741.050811:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855741.050833:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6780 going to sleep for 11 seconds 00000100:00100000:3.0:1787855741.050987:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486240512 00000100:00100000:3.0:1787855741.050993:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486240512 00000100:00100000:3.0:1787855741.051032:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787855741.051040:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486240512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855741.051051:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855741.051065:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73d1229a00/0x516929ca3366d645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d63e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.051087:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1229a00/0x516929ca3366d645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d63e expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.051096:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73d1229a00/0x516929ca3366d645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d63e expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.051104:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229a00, rc 0) 00000100:00100000:3.0:1787855741.051140:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486240512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855741.051146:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787855741.051331:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0a30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486240512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787855741.051344:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c5142000/0x516929ca3366d63e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d645 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855741.051352:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c5142000/0x516929ca3366d63e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d645 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855741.051398:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0a30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486240640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787855741.051422:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855741.051450:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787855741.051465:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486240640 00000100:00100000:0.0:1787855741.051468:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486240640 00000100:00100000:0.0:1787855741.051489:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787855741.051496:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486240640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787855741.051993:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486240640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (273us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787855741.052004:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787855741.052035:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0a30c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486240640:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787855741.052053:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787855741.052059:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5142000/0x516929ca3366d63e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d645 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855741.052066:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c5142000/0x516929ca3366d63e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d645 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855741.055208:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486240768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787855741.055280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855741.055369:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486240768 00000100:00100000:0.0:1787855741.055378:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486240768 00000100:00100000:0.0:1787855741.055430:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787855741.055441:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc2543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486240768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787855741.055474:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855741.055521:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc2543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486240768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855741.055528:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787855741.055563:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73c9283480 x1874702486240768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855741.055581:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486240768:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1787855741.381492:0:8489:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3f7a54e0 20000000:00000080:3.0:1787855741.381757:0:8489:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a72c308c800 uarg=0000000000000000 20000000:01000000:3.0:1787855741.381814:0:8489:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787855741.381821:0:8489:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787855741.381825:0:8489:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787855741.382991:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787855741.383159:0:8489:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787855741.393217:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787855741.393277:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787855741.393333:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787855741.393350:0:8489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787855741.393369:0:8489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a73c166d600/0x516929ca3366d64c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.393387:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a7402047400/0x516929ca3366d3c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d3ba expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.393395:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c0031600/0x516929ca3366d423 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d41c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.393402:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a7402172e00/0x516929ca3366d4ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d4e7 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.393411:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d5ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169f7 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.393418:0:8489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a73c166d600/0x516929ca3366d64c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.393465:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d5ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169f7 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.393481:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d5ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169f7 expref: 9 pid: 5826 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855741.393495:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa094b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874702486240896:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855741.393767:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a7402172e00/0x516929ca3366d4ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d4e7 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.393818:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a7402172e00/0x516929ca3366d4ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d4e7 expref: 18 pid: 5827 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855741.393828:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa097480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874702486241024:0@lo:104: 00000100:00100000:1.0:1787855741.393871:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787855741.393910:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c0031600/0x516929ca3366d423 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d41c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.393919:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a73c0031600/0x516929ca3366d423 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d41c expref: 18 pid: 5826 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855741.393927:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa094f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874702486241152:0@lo:104: 00000100:00100000:1.0:1787855741.393953:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787855741.393981:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a7402047400/0x516929ca3366d3c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d3ba expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.394004:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a7402047400/0x516929ca3366d3c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d3ba expref: 18 pid: 5828 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855741.394024:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0943c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874702486241280:0@lo:104: 00000100:00100000:1.0:1787855741.394045:0:8489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa2b0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787855741.394279:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787855741.394299:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855741.394319:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486241024 00000100:00100000:3.0:1787855741.394325:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486241024 00000100:00100000:3.0:1787855741.394358:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486241152 00000100:00100000:3.0:1787855741.394361:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486241152 00000100:00100000:3.0:1787855741.394370:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486241280 00000100:00100000:3.0:1787855741.394372:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486241280 00000100:00100000:3.0:1787855741.394384:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787855741.394392:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa096580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+5:8489:x1874702486241024:12345-0@lo:104: 00010000:00010000:3.0:1787855741.394403:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d4e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d4ee expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394452:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787855741.394457:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa096580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+5:8489:x1874702486241024:12345-0@lo:104: Request processed in 67us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855741.394464:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787855741.394479:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787855741.394484:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3303c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+4:8489:x1874702486241152:12345-0@lo:104: 00010000:00010000:3.0:1787855741.394492:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a7402173200/0x516929ca3366d41c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d423 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394552:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787855741.394557:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3303c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+4:8489:x1874702486241152:12345-0@lo:104: Request processed in 73us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855741.394564:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787855741.394605:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787855741.394614:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9280f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:8489:x1874702486241280:12345-0@lo:104: 00010000:00010000:3.0:1787855741.394622:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73c0031200/0x516929ca3366d3ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d3c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394646:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787855741.394651:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9280f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:8489:x1874702486241280:12345-0@lo:104: Request processed in 40us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855741.394656:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787855741.394676:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787855741.394681:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d4e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d4ee expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394688:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402046000 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:3.0:1787855741.394700:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d4e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d4ee expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394709:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d4e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d4ee expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787855741.394716:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d4e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d4ee expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855741.394721:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787855741.394755:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d4e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d4ee expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394762:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787855741.394802:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d4e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d4ee expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394809:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402046000/0x516929ca3366d4e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d4ee expref: -99 pid: 7610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394821:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787855741.394824:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402173200/0x516929ca3366d41c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d423 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394830:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402173200 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:3.0:1787855741.394832:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402173200/0x516929ca3366d41c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d423 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394839:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402173200/0x516929ca3366d41c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d423 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787855741.394845:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402173200/0x516929ca3366d41c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d423 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855741.394850:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787855741.394864:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402173200/0x516929ca3366d41c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d423 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394869:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787855741.394875:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402173200/0x516929ca3366d41c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d423 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394892:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402173200/0x516929ca3366d41c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d423 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394901:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787855741.394904:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c0031200/0x516929ca3366d3ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d3c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394909:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c0031200 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:3.0:1787855741.394912:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c0031200/0x516929ca3366d3ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d3c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394918:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c0031200/0x516929ca3366d3ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d3c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787855741.394924:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c0031200/0x516929ca3366d3ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d3c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855741.394930:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787855741.394942:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c0031200/0x516929ca3366d3ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d3c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394947:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787855741.394962:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c0031200/0x516929ca3366d3ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d3c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.394969:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c0031200/0x516929ca3366d3ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d3c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.395003:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855741.395010:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855741.395012:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855741.395018:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855741.395029:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9281a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486241408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787855741.395059:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855741.395082:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787855741.395087:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9283840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486241536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787855741.395114:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855741.395141:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486241664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787855741.395163:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855741.395195:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486241408 00000100:00100000:3.0:1787855741.395205:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486241408 00010000:00010000:3.0:1787855741.395224:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a7402172e00/0x516929ca3366d4ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d4e7 expref: 19 pid: 5827 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855741.395247:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486241536 00000100:00100000:3.0:1787855741.395251:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486241536 00010000:00010000:3.0:1787855741.395261:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c0031600/0x516929ca3366d423 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d41c expref: 20 pid: 5826 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855741.395270:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486241664 00000100:00100000:3.0:1787855741.395272:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486241664 00010000:00010000:3.0:1787855741.395280:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a7402047400/0x516929ca3366d3c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d3ba expref: 21 pid: 5828 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855741.395290:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787855741.395295:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9280b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+21:3306:x1874702486241408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787855741.395305:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855741.395310:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a7402172e00/0x516929ca3366d4ee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d4e7 expref: 21 pid: 5827 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.395326:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a7402172e00/0x516929ca3366d4ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d4e7 expref: 21 pid: 5827 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.395343:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855741.395371:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9280b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+21:3306:x1874702486241408:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855741.395378:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787855741.395392:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787855741.395397:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9281680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+20:3306:x1874702486241536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787855741.395405:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855741.395410:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c0031600/0x516929ca3366d423 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d41c expref: 20 pid: 5826 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.395418:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c0031600/0x516929ca3366d423 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d41c expref: 20 pid: 5826 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.395428:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855741.395449:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9281680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+20:3306:x1874702486241536:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855741.395455:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787855741.395467:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787855741.395473:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9283480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486241664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787855741.395480:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855741.395484:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a7402047400/0x516929ca3366d3c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d3ba expref: 19 pid: 5828 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.395492:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a7402047400/0x516929ca3366d3c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d3ba expref: 19 pid: 5828 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.395508:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855741.395533:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9283480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486241664:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855741.395539:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787855741.395581:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486241664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787855741.395617:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9283840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486241536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787855741.395624:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9281a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486241408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787855741.396216:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402172e00/0x516929ca3366d4ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d4e7 expref: 18 pid: 5827 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855741.396227:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa097480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874702486241024:0@lo:104: 00010000:00010000:1.0:1787855741.396236:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c0031600/0x516929ca3366d423 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d41c expref: 17 pid: 5826 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855741.396244:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa094f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874702486241152:0@lo:104: 00010000:00010000:1.0:1787855741.396252:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402047400/0x516929ca3366d3c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d3ba expref: 16 pid: 5828 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855741.396260:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0943c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874702486241280:0@lo:104: 00000100:00100000:2.0:1787855741.400627:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855741.400934:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464194048 00000100:00100000:3.0:1787855741.400943:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464194048 00010000:00010000:3.0:1787855741.400982:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d5ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169f7 expref: 10 pid: 5826 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855741.401014:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:3.0:1787855741.401023:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7648b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2357:x1874702464194048:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787855741.401037:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855741.401042:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d5ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169f7 expref: 10 pid: 5826 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.401054:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d5ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169f7 expref: 10 pid: 5826 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.401076:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a73c166d600/0x516929ca3366d64c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.401085:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c166d600/0x516929ca3366d64c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.401119:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73c166d600/0x516929ca3366d64c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.401126:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73c166d600/0x516929ca3366d64c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.401132:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a73c166d600/0x516929ca3366d64c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.401139:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a73c166d600/0x516929ca3366d64c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.401145:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166d600 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787855741.401149:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a73c166d600/0x516929ca3366d64c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.401157:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a73c166d600/0x516929ca3366d64c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.401167:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a73c166d600/0x516929ca3366d64c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.401177:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855741.401240:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7648b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2357:x1874702464194048:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 216us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855741.401248:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00010000:00010000:1.0:1787855741.402825:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d5ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169f7 expref: 9 pid: 5826 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855741.402843:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa094b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874702486240896:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855741.402873:0:8489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a73c166d600/0x516929ca3366d64c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.403103:0:8489:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a73c166d600/0x516929ca3366d64c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.403110:0:8489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a73c166d600/0x516929ca3366d64c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855741.403117:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c166d600/0x516929ca3366d64c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855741.620601:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855741.620735:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464194176 00000100:00100000:3.0:1787855741.620744:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464194176 00000100:00100000:3.0:1787855741.621056:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 169 00000100:00100000:3.0:1787855741.621067:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+9:5598:x1874702464194176:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855741.621100:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855741.621121:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73d1228e00/0x516929ca3366d653 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616a36 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.621149:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1228e00/0x516929ca3366d653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a36 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.621161:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73d1228e00/0x516929ca3366d653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a36 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855741.621170:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228e00, rc 0) 00000100:00100000:3.0:1787855741.621229:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5598:x1874702464194176:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 164us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855741.621236:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 169 00000100:00100000:2.0:1787855741.635945:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855741.636258:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464194304 00000100:00100000:3.0:1787855741.636267:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464194304 00000100:00100000:3.0:1787855741.636384:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 170 00000100:00100000:3.0:1787855741.636396:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5598:x1874702464194304:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855741.636890:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5598:x1874702464194304:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 494us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855741.636898:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 170 00000100:00100000:2.0:1787855741.645022:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855741.645314:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464194432 00000100:00100000:3.0:1787855741.645323:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464194432 00000100:00100000:2.0:1787855741.645573:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 171 00000100:00100000:2.0:1787855741.645585:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5598:x1874702464194432:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787855741.646270:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:5598:x1874702464194432:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 685us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855741.646279:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 171 00000100:00100000:0.0:1787855741.659659:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855741.663162:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464194560 00000100:00100000:3.0:1787855741.663179:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464194560 00000100:00100000:3.0:1787855741.663300:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 172 00000100:00100000:3.0:1787855741.663312:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:6107:x1874702464194560:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787855741.663574:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:6107:x1874702464194560:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 264us (3924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855741.663583:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 172 00000100:00100000:0.0:1787855741.678887:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855741.679524:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464194688 00000100:00100000:2.0:1787855741.679535:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464194688 00000100:00100000:2.0:1787855741.679622:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 173 00000100:00100000:2.0:1787855741.679633:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:6107:x1874702464194688:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787855741.679913:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:6107:x1874702464194688:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 281us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855741.679932:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 173 00010000:00010000:3.0:1787855741.692069:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855742.733898:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787855742.971866:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787855742.971878:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73e762a800 from 4 10000000:01000000:1.0:1787855742.971885:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787855742.971948:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366d65a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855742.971963:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366d65a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855742.971978:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366d65a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855742.972012:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0943c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486241792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787855742.972112:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855742.972185:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa6ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855742.972216:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486241792 00000100:00100000:1.0:1787855742.972224:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486241792 00000100:00100000:1.0:1787855742.972298:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787855742.972309:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486241792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787855742.972326:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855742.972342:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d661 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d65a expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855742.972372:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d65a expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855742.972385:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d65a expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855742.972411:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166ce00, rc 0) 00000100:00100000:1.0:1787855742.972461:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486241792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855742.972469:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787855742.972527:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0943c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486241792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787855742.972545:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366d65a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d661 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855742.972555:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366d65a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d661 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855742.972636:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0943c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486241920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787855742.972669:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855742.972688:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa6ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855742.972703:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486241920 00000100:00100000:1.0:1787855742.972707:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486241920 00000100:00100000:1.0:1787855742.972745:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787855742.972753:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486241920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787855742.973106:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486241920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 352us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855742.973114:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787855742.973152:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0943c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486241920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787855742.973187:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0943c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486242048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787855742.973231:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855742.973258:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa6ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855742.973271:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486242048 00000100:00100000:1.0:1787855742.973274:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486242048 00000100:00100000:1.0:1787855742.973300:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787855742.973306:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486242048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787855742.973455:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486242048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855742.973463:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787855742.973500:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0943c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486242048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787855742.980978:0:8555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0a0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8555:1874702486242176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855742.981105:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855742.981380:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486242176 00000100:00100000:3.0:1787855742.981391:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486242176 00000100:00100000:0.0:1787855742.981402:0:8555:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6240 going to sleep for 11 seconds 00000100:00100000:3.0:1787855742.981453:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787855742.981466:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:8555:x1874702486242176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855742.981816:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:8555:x1874702486242176:12345-0@lo:502:llog_process_th.0 Request processed in 351us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855742.981827:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787855742.981847:0:8555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0a0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8555:1874702486242176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787855742.981889:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787855742.981902:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855742.981904:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787855742.981914:0:8555:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a73e762a800 00000020:00000080:0.0:1787855742.981916:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787855742.982010:0:8555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0a0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8555:1874702486242304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855742.982053:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855742.982076:0:8555:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6240 going to sleep for 11 seconds 00000100:00100000:1.0:1787855742.983437:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486242304 00000100:00100000:1.0:1787855742.983453:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486242304 00000100:00100000:1.0:1787855742.983511:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787855742.983522:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:8555:x1874702486242304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787855742.984491:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:8555:x1874702486242304:12345-0@lo:502:llog_process_th.0 Request processed in 967us (2434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855742.984503:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787855742.984551:0:8555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0a0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8555:1874702486242304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787855742.984607:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787855742.984617:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855742.984620:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787855742.984627:0:8555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787855742.985995:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787855742.986030:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787855742.986046:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366d65a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d661 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855742.986061:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366d65a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d661 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787855742.986074:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787855742.986077:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73d0d01000 from 4 10000000:01000000:1.0:1787855742.986081:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787855742.986127:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166d000/0x516929ca3366d668 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855742.986144:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c166d000/0x516929ca3366d668 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855742.986157:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c166d000/0x516929ca3366d668 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855742.986185:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa094b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486242432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787855742.986259:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855742.986851:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa6edcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855742.987248:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486242432 00000100:00100000:1.0:1787855742.987258:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486242432 00000100:00100000:1.0:1787855742.988455:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787855742.988473:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486242432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787855742.988495:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855742.988517:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c166d600/0x516929ca3366d66f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d668 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855742.988554:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c166d600/0x516929ca3366d66f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d668 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855742.988578:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c166d600/0x516929ca3366d66f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d668 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855742.988589:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166d600, rc 0) 00000100:00100000:1.0:1787855742.988679:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486242432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (2420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855742.988688:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787855742.990447:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa094b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486242432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787855742.990481:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c166d000/0x516929ca3366d668 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d66f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855742.990495:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c166d000/0x516929ca3366d668 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d66f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855742.990620:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa094b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486242560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787855742.990688:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855742.990737:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa6edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855742.991391:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486242560 00000100:00100000:0.0:1787855742.991399:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486242560 00000100:00100000:0.0:1787855742.991452:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787855742.991463:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486242560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787855742.991863:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486242560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 400us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855742.991881:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787855742.991949:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa094b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486242560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787855742.991997:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486242688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787855742.992044:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855742.992078:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855742.992094:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486242688 00000100:00100000:0.0:1787855742.992098:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486242688 00000100:00100000:0.0:1787855742.992124:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787855742.992132:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486242688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787855742.995271:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486242688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3131us (3218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855742.995289:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787855742.996139:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486242688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787855742.996594:0:8558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0a2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8558:1874702486242816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855742.996675:0:8558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855742.996855:0:8558:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787855743.001496:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486242816 00000100:00100000:3.0:1787855743.001518:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486242816 00000100:00100000:3.0:1787855743.001613:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787855743.001625:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:8558:x1874702486242816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855743.003425:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:8558:x1874702486242816:12345-0@lo:502:llog_process_th.0 Request processed in 1791us (6739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855743.003442:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787855743.004591:0:8558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0a2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8558:1874702486242816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787855743.004653:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787855743.004667:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855743.004670:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787855743.004677:0:8558:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a73d0d01000 00000020:00000080:1.0:1787855743.004681:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787855743.004851:0:8558:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0943c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8558:1874702486242944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787855743.004928:0:8558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855743.004967:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486242944 00000100:00100000:0.0:1787855743.004977:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486242944 00000100:00100000:1.0:1787855743.004979:0:8558:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa6ed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855743.005046:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787855743.005058:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:8558:x1874702486242944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855743.005305:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:8558:x1874702486242944:12345-0@lo:502:llog_process_th.0 Request processed in 249us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855743.005314:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787855743.005421:0:8558:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0943c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8558:1874702486242944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787855743.005446:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787855743.005451:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855743.005453:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787855743.005458:0:8558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787855743.005644:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787855743.005668:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787855743.005681:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166d000/0x516929ca3366d668 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d66f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855743.005693:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c166d000/0x516929ca3366d668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d66f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855743.005717:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787855743.005730:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73f4b59000 from 4 10000000:01000000:3.0:1787855743.005733:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787855743.005768:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1228a00/0x516929ca3366d676 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855743.005804:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73d1228a00/0x516929ca3366d676 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855743.005815:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73d1228a00/0x516929ca3366d676 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855743.005833:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9283840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486243072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787855743.005872:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855743.005901:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50ccb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787855743.006503:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486243072 00000100:00100000:1.0:1787855743.006511:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486243072 00000100:00100000:1.0:1787855743.006551:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787855743.006561:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486243072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787855743.006591:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855743.006608:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c0031200/0x516929ca3366d67d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d676 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855743.006636:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c0031200/0x516929ca3366d67d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d676 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855743.006648:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c0031200/0x516929ca3366d67d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d676 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855743.006658:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c0031200, rc 0) 00000100:00100000:1.0:1787855743.006711:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486243072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855743.006730:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787855743.008536:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9283840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486243072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855743.008578:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73d1228a00/0x516929ca3366d676 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d67d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855743.008591:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73d1228a00/0x516929ca3366d676 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d67d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855743.008687:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9283840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486243200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855743.012093:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855743.012168:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50ccb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787855743.012205:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486243200 00000100:00100000:3.0:1787855743.012215:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486243200 00000100:00100000:3.0:1787855743.012831:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787855743.012844:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486243200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855743.013194:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486243200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 352us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855743.013203:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787855743.013271:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9283840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486243200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855743.015609:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9283840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486243328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787855743.016874:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855743.016961:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50ccb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787855743.017002:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486243328 00000100:00100000:3.0:1787855743.017014:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486243328 00000100:00100000:3.0:1787855743.017078:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787855743.017088:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486243328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787855743.020042:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486243328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2942us (4311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855743.020060:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787855743.020175:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9283840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486243328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787855743.021430:0:8560:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9283840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8560:1874702486243456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855743.021518:0:8560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855743.021561:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486243456 00000100:00100000:3.0:1787855743.021579:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486243456 00000100:00100000:3.0:1787855743.021629:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787855743.021639:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:8560:x1874702486243456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855743.021930:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:8560:x1874702486243456:12345-0@lo:502:llog_process_th.0 Request processed in 291us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855743.021946:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787855743.022007:0:8560:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787855743.022030:0:8560:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9283840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8560:1874702486243456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787855743.022063:0:8560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787855743.022075:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855743.022078:0:8560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787855743.022086:0:8560:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a73f4b59000 00000020:00000080:3.0:1787855743.022088:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787855743.022193:0:8560:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9283840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8560:1874702486243584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855743.022232:0:8560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855743.022260:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486243584 00000100:00100000:3.0:1787855743.022264:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486243584 00000100:00100000:3.0:1787855743.022290:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787855743.022297:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:8560:x1874702486243584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855743.022420:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:8560:x1874702486243584:12345-0@lo:502:llog_process_th.0 Request processed in 122us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855743.022428:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787855743.022458:0:8560:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787855743.022469:0:8560:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9283840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:8560:1874702486243584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787855743.022489:0:8560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787855743.022493:0:8560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855743.022495:0:8560:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787855743.022499:0:8560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787855743.022582:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787855743.022602:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787855743.022614:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1228a00/0x516929ca3366d676 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d67d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855743.022632:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73d1228a00/0x516929ca3366d676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d67d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855743.743890:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855744.765425:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855744.933390:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855744.933442:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855744.933478:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855744.933509:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855744.933552:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464194944 00000100:00100000:2.0:1787855744.933565:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464194944 00000100:00100000:2.0:1787855744.933648:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:0.0:1787855744.933761:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464195072 00000100:00100000:0.0:1787855744.933767:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464195072 00000100:00100000:0.0:1787855744.933828:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464195200 00000100:00100000:0.0:1787855744.933832:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464195200 00000100:00100000:0.0:1787855744.933855:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:0.0:1787855744.933865:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464195072:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855744.933958:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464195072:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 94us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855744.933966:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:0.0:1787855744.933985:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:0.0:1787855744.933992:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f76483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464195200:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855744.934031:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f76483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464195200:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 40us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855744.934038:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00080000:0.0:1787855744.934199:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787855744.934223:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787855744.934227:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855744.934573:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464194816 00000100:00100000:3.0:1787855744.934580:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464194816 00000100:00100000:3.0:1787855744.934950:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 189 00000100:00100000:3.0:1787855744.934964:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2357:x1874702464194816:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855744.934981:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f76492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464194944:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855744.935039:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2357:x1874702464194816:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 77us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855744.935040:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f76492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464194944:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 68us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855744.935057:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 189 00000100:00100000:2.0:1787855744.935059:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:0.0:1787855745.150417:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486243712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787855745.150526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855745.151000:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486243712 00000100:00100000:1.0:1787855745.151012:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486243712 00000100:00100000:1.0:1787855745.151140:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787855745.151153:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486243712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787855745.151214:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787855745.151291:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486243712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855745.151300:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787855745.151472:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73c92830c0 x1874702486243712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855745.151497:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486243712:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787855745.151551:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787855745.664103:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486244096:0@lo:400:kworker.0 00000100:00100000:3.0:1787855745.664217:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855745.664302:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787855745.664309:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486244224:0@lo:400:kworker.0 00000100:00100000:3.0:1787855745.664338:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855745.664385:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486244096 00000100:00100000:3.0:1787855745.664394:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486244096 00000100:00100000:3.0:1787855745.664461:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486244224 00000100:00100000:3.0:1787855745.664465:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486244224 00000100:00100000:3.0:1787855745.664491:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787855745.664501:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486244096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855745.664577:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486244096:12345-0@lo:400:kworker.0 Request processed in 76us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855745.664585:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787855745.664604:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787855745.664625:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486244224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855745.664658:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486244224:12345-0@lo:400:kworker.0 Request processed in 34us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855745.664664:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787855745.664700:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855745.664752:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486244224:0@lo:400:kworker.0 00000100:00100000:3.0:1787855745.664766:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486244096:0@lo:400:kworker.0 00000100:00100000:0.0:1787855745.665279:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486243840:0@lo:400:kworker.0 00000100:00100000:0.0:1787855745.665328:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855745.665360:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9281a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486244352:0@lo:400:kworker.0 00000100:00100000:0.0:1787855745.665389:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855745.665414:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787855745.665421:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486243968:0@lo:400:kworker.0 00000100:00100000:0.0:1787855745.665447:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855745.665478:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486244352 00000100:00100000:0.0:1787855745.665493:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486244352 00000100:00100000:0.0:1787855745.665556:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787855745.665564:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486244352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855745.665609:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486244352:12345-0@lo:400:kworker.0 Request processed in 46us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855745.665615:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787855745.665657:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73c9281a40 x1874702486244352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855745.665684:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9281a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486244352:0@lo:400:kworker.0 00000100:00100000:3.0:1787855745.666640:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486243840 00000100:00100000:3.0:1787855745.666653:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486243840 00000100:00100000:3.0:1787855745.666722:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787855745.666742:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3306:x1874702486243840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855745.666846:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3306:x1874702486243840:12345-0@lo:400:kworker.0 Request processed in 115us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855745.666853:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:3.0:1787855745.666890:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787855745.666904:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486243968 00000100:00100000:3.0:1787855745.666908:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486243968 00000100:00100000:3.0:1787855745.666936:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787855745.666942:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486243968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855745.666976:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486243968:12345-0@lo:400:kworker.0 Request processed in 34us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855745.666982:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787855745.667255:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486243968:0@lo:400:kworker.0 00000100:00100000:1.0:1787855745.667267:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486243840:0@lo:400:kworker.0 00010000:00010000:3.0:1787855745.788083:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855746.173027:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486244480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787855746.173126:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855746.173296:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486244480 00000100:00100000:2.0:1787855746.173307:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486244480 00000100:00100000:2.0:1787855746.173380:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787855746.173393:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa094f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486244480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787855746.173441:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787855746.173592:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa094f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486244480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 201us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855746.173600:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787855746.177555:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73c92821c0 x1874702486244480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855746.177595:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486244480:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787855746.821307:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855747.839980:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787855748.482452:0:8789:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1787855748.860967:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855749.884027:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855750.052944:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855750.052990:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855750.053030:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855750.053061:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855750.053097:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464195584 00000100:00100000:2.0:1787855750.053107:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464195584 00000100:00100000:2.0:1787855750.053158:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464195712 00000100:00100000:2.0:1787855750.053161:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464195712 00000100:00100000:2.0:1787855750.053181:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:2.0:1787855750.053193:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464195584:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855750.053260:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464195584:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 71us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855750.053269:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:2.0:1787855750.053285:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:2.0:1787855750.053293:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464195712:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855750.053320:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464195712:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 28us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855750.053326:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:3.0:1787855750.053398:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464195456 00000100:00100000:3.0:1787855750.053403:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464195456 00000100:00100000:3.0:1787855750.053444:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:3.0:1787855750.053469:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464195456:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855750.053516:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464195456:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 49us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855750.053523:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00080000:3.0:1787855750.053543:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787855750.053548:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787855750.053550:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787855750.053905:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464195328 00000100:00100000:0.0:1787855750.053912:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464195328 00000100:00100000:0.0:1787855750.053951:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 191 00000100:00100000:0.0:1787855750.053959:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2357:x1874702464195328:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855750.053990:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2357:x1874702464195328:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 31us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855750.053996:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 191 00000100:00100000:3.0:1787855750.270375:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486244608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855750.270463:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855750.270653:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486244608 00000100:00100000:0.0:1787855750.270662:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486244608 00000100:00100000:0.0:1787855750.270731:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787855750.270754:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9281a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486244608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787855750.270812:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855750.270860:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9281a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486244608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855750.270881:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787855750.271072:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787855750.271104:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73fa0a0000 x1874702486244608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855750.271122:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486244608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855750.781086:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486244736:0@lo:400:kworker.0 00000100:00100000:3.0:1787855750.781203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855750.781258:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d8960780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486245248:0@lo:400:kworker.0 00000100:00100000:3.0:1787855750.781314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855750.781923:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9283840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486244992:0@lo:400:kworker.0 00000100:00100000:1.0:1787855750.781971:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855750.782003:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787855750.782012:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486244864:0@lo:400:kworker.0 00000100:00100000:1.0:1787855750.782038:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855750.782365:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787855750.782378:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486245120:0@lo:400:kworker.0 00000100:00100000:3.0:1787855750.782411:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855750.782466:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486244736 00000100:00100000:3.0:1787855750.782474:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486244736 00000100:00100000:3.0:1787855750.782531:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787855750.782540:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c446b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486244736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855750.782733:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486244992 00000100:00100000:1.0:1787855750.782741:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486244992 00000100:00100000:1.0:1787855750.782794:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486244864 00000100:00100000:1.0:1787855750.782797:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486244864 00000100:00100000:1.0:1787855750.782806:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486245120 00000100:00100000:1.0:1787855750.782807:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486245120 00000100:00100000:1.0:1787855750.782818:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787855750.782822:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486244992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855750.782852:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486244992:12345-0@lo:400:kworker.0 Request processed in 30us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855750.782857:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787855750.782871:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787855750.782874:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa095e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486244864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855750.782889:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa095e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486244864:12345-0@lo:400:kworker.0 Request processed in 15us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855750.782893:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787855750.782898:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787855750.782901:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486245120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855750.782931:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486245120:12345-0@lo:400:kworker.0 Request processed in 30us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855750.782935:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787855750.782950:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855750.782978:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486244864:0@lo:400:kworker.0 00000100:00100000:1.0:1787855750.782985:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9283840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486244992:0@lo:400:kworker.0 00000100:00100000:1.0:1787855750.783005:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486245120:0@lo:400:kworker.0 00000100:00100000:3.0:1787855750.783505:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c446b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486244736:12345-0@lo:400:kworker.0 Request processed in 963us (2299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855750.783522:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787855750.783568:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486245248 00000100:00100000:3.0:1787855750.783573:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486245248 00000100:00100000:3.0:1787855750.783694:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787855750.783702:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486245248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855750.783743:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486245248:12345-0@lo:400:kworker.0 Request processed in 42us (2429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855750.783749:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787855750.783987:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787855750.784014:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486244736:0@lo:400:kworker.0 00010000:00080000:1.0:1787855750.784028:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d8960780 x1874702486245248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855750.784038:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d8960780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486245248:0@lo:400:kworker.0 00010000:00010000:2.0:1787855750.914560:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855751.296230:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9de6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486245376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787855751.296302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855751.296372:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486245376 00000100:00100000:0.0:1787855751.296380:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486245376 00000100:00100000:0.0:1787855751.296435:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787855751.296444:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486245376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787855751.296479:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855751.296525:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486245376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855751.296533:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787855751.296578:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73f9de6580 x1874702486245376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855751.296598:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9de6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486245376:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787855751.932958:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855752.956632:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787855753.423446:0:9033:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing yml_node 00010000:00010000:2.0:1787855753.981799:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855755.009162:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855755.177799:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855755.177921:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855755.178026:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464195840 00000100:00100000:0.0:1787855755.178036:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464195840 00000100:00100000:0.0:1787855755.178094:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 193 00000100:00100000:0.0:1787855755.178103:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c446a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2360:x1874702464195840:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855755.178185:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c446a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2360:x1874702464195840:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 83us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855755.178193:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 193 00000100:00100000:1.0:1787855755.179096:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464195968 00000100:00100000:1.0:1787855755.179106:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464195968 00000100:00100000:1.0:1787855755.179230:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:1.0:1787855755.179240:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464195968:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855755.179315:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464195968:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 77us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855755.179322:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00080000:2.0:1787855755.181158:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855755.186533:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855755.186637:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855755.187769:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464196096 00000100:00100000:0.0:1787855755.187810:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464196096 00000100:00100000:0.0:1787855755.187883:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464196224 00000100:00100000:0.0:1787855755.187887:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464196224 00000100:00100000:0.0:1787855755.187917:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:0.0:1787855755.187928:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2356:x1874702464196096:12345-192.168.201.38@tcp:9:kworker.0 00000020:00000080:0.0:1787855755.187981:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d5b9 00000100:00080000:0.0:1787855755.187992:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9a73fa3cf800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787855755.188030:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787855755.188403:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+2:2356:x1874702464196096:12345-192.168.201.38@tcp:9:kworker.0 Request processed in 475us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855755.188412:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:0.0:1787855755.188431:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:0.0:1787855755.188439:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2356:x1874702464196224:12345-192.168.201.38@tcp:9:kworker.0 00010000:00010000:2.0:1787855755.188680:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787855755.188691:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787855755.188695:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1787855755.189680:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d5c0 00000100:00080000:0.0:1787855755.189695:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9a73fa51f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787855755.189744:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787855755.190141:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855755.190192:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+2:2356:x1874702464196224:12345-192.168.201.38@tcp:9:kworker.0 Request processed in 1751us (3551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855755.190202:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:2.0:1787855755.388116:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787855755.388151:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486245504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787855755.388223:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855755.388338:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486245504 00000100:00100000:0.0:1787855755.388344:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486245504 00000100:00100000:0.0:1787855755.388414:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787855755.388422:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486245504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787855755.388452:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855755.388492:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486245504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855755.388497:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787855755.388531:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73fa0a3480 x1874702486245504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855771 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855755.388553:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486245504:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787855755.388568:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787855755.902238:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486245888:0@lo:400:kworker.0 00000100:00100000:2.0:1787855755.902482:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486245760:0@lo:400:kworker.0 00000100:00100000:2.0:1787855755.902538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855755.902613:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787855755.902619:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486245632:0@lo:400:kworker.0 00000100:00100000:2.0:1787855755.902649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855755.902672:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1378f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486246144:0@lo:400:kworker.0 00000100:00100000:2.0:1787855755.902695:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855755.902725:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486245760 00000100:00100000:2.0:1787855755.902732:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486245760 00000100:00100000:2.0:1787855755.902808:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787855755.902819:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486245760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855755.902867:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486245760:12345-0@lo:400:kworker.0 Request processed in 51us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855755.902887:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787855755.902912:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486245632 00000100:00100000:2.0:1787855755.902915:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486245632 00000100:00100000:2.0:1787855755.902941:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787855755.902948:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486245632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855755.902977:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486245632:12345-0@lo:400:kworker.0 Request processed in 30us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855755.902983:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787855755.903021:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486246144 00000100:00100000:2.0:1787855755.903024:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486246144 00000100:00100000:2.0:1787855755.903069:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787855755.903084:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7649a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486246144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855755.903113:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7649a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486246144:12345-0@lo:400:kworker.0 Request processed in 32us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855755.903119:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787855755.903132:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787855755.903155:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486245632:0@lo:400:kworker.0 00010000:00080000:2.0:1787855755.903168:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d1378f00 x1874702486246144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855755.903179:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1378f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486246144:0@lo:400:kworker.0 00000100:00100000:2.0:1787855755.903189:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486245760:0@lo:400:kworker.0 00000100:00100000:1.0:1787855755.904011:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d137b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486246016:0@lo:400:kworker.0 00000100:00100000:1.0:1787855755.904067:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855755.904115:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486246016 00000100:00100000:1.0:1787855755.904121:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486246016 00000100:00100000:1.0:1787855755.904170:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787855755.904177:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa097c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486246016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855755.904218:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa097c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486246016:12345-0@lo:400:kworker.0 Request processed in 41us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855755.904223:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787855755.904255:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d137b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486246016:0@lo:400:kworker.0 00000100:00100000:0.0:1787855755.904760:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787855755.905437:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855755.906266:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486245888 00000100:00100000:1.0:1787855755.906276:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486245888 00000100:00100000:1.0:1787855755.906365:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787855755.906374:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486245888:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787855755.906713:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855755.906768:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486245888:12345-0@lo:400:kworker.0 Request processed in 394us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855755.906816:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787855755.907626:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486245888:0@lo:400:kworker.0 00010000:00010000:2.0:1787855756.031193:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855756.413998:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787855756.414022:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9de4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486246272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787855756.414223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855756.414397:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486246272 00000100:00100000:3.0:1787855756.414405:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486246272 00000100:00100000:3.0:1787855756.414464:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787855756.414474:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486246272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787855756.414512:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855756.414562:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486246272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855756.414569:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787855756.414603:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73f9de4780 x1874702486246272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855756.414640:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9de4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486246272:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787855756.502927:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6933b672-fa85-4aae-9dc8-092c3f355bbf 00000020:00000080:2.0:1787855756.502938:0:6703:0:(genops.c:885:class_export_put()) final put ffff9a73fa3cc800/6933b672-fa85-4aae-9dc8-092c3f355bbf 00000020:00000080:0.0:1787855756.503131:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73fa3cc800/6933b672-fa85-4aae-9dc8-092c3f355bbf for lustre-OST0000 00000020:00000080:0.0:1787855756.503190:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a73fa3cf800 for lustre-OST0000 00010000:00010000:2.0:1787855757.052215:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855758.076017:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787855758.547172:0:9227:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.82 00000001:00100000:0.0:1787855759.056627:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6933b672-fa85-4aae-9dc8-092c3f355bbf 00000020:00000080:0.0:1787855759.056640:0:7628:0:(genops.c:885:class_export_put()) final put ffff9a73fa51b000/6933b672-fa85-4aae-9dc8-092c3f355bbf 00000020:00000080:1.0:1787855759.058563:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73fa51b000/6933b672-fa85-4aae-9dc8-092c3f355bbf for lustre-OST0001 00000020:00000080:1.0:1787855759.058647:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a73fa51f800 for lustre-OST0001 00010000:00010000:2.0:1787855759.103990:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855760.131145:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855760.302746:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855760.302864:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855760.302964:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464196352 00000100:00100000:0.0:1787855760.302978:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464196352 00000100:00100000:0.0:1787855760.303056:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 195 00000100:00100000:0.0:1787855760.303071:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2360:x1874702464196352:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855760.303172:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2360:x1874702464196352:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 104us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855760.303181:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 195 00000100:00100000:1.0:1787855760.303197:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464196480 00000100:00100000:1.0:1787855760.303202:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464196480 00000100:00100000:1.0:1787855760.303282:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:1.0:1787855760.303299:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464196480:12345-192.168.201.38@tcp:400:kworker.0 00000100:00080000:3.0:1787855760.303742:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855760.303925:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464196480:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 49us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855760.303936:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:3.0:1787855760.512570:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1379a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486246400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855760.512684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855760.513130:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486246400 00000100:00100000:0.0:1787855760.513144:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486246400 00000100:00100000:0.0:1787855760.513240:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787855760.513251:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486246400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787855760.513318:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855760.513398:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486246400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855760.513406:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787855760.513913:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787855760.514067:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d1379a40 x1874702486246400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855760.514107:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1379a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486246400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787855761.022981:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa095a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486246784:0@lo:400:kworker.0 00000100:00100000:1.0:1787855761.023082:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855761.023162:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787855761.023190:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa096d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486246656:0@lo:400:kworker.0 00000100:00100000:1.0:1787855761.023217:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855761.023268:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486246784 00000100:00100000:1.0:1787855761.023278:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486246784 00000100:00100000:1.0:1787855761.024065:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486246656 00000100:00100000:1.0:1787855761.024075:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486246656 00000100:00100000:1.0:1787855761.024115:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787855761.024128:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486246784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855761.024222:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486246784:12345-0@lo:400:kworker.0 Request processed in 97us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855761.024230:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787855761.024252:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787855761.024472:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486246528:0@lo:400:kworker.0 00000100:00100000:2.0:1787855761.024523:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855761.024574:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486247040:0@lo:400:kworker.0 00000100:00100000:2.0:1787855761.024619:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855761.024644:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787855761.024650:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa094780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486246912:0@lo:400:kworker.0 00000100:00100000:2.0:1787855761.024671:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855761.024696:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486246528 00000100:00100000:2.0:1787855761.024700:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486246528 00000100:00100000:2.0:1787855761.024735:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787855761.024744:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486246528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855761.024797:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486246528:12345-0@lo:400:kworker.0 Request processed in 54us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855761.024804:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787855761.024848:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486247040 00000100:00100000:2.0:1787855761.024851:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486247040 00000100:00100000:2.0:1787855761.024883:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787855761.024889:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486247040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855761.024918:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486247040:12345-0@lo:400:kworker.0 Request processed in 29us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855761.024923:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787855761.025137:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486246528:0@lo:400:kworker.0 00010000:00080000:2.0:1787855761.025152:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73fa097480 x1874702486247040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855761.025163:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486247040:0@lo:400:kworker.0 00000100:00100000:1.0:1787855761.028082:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa094b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486246656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855761.028230:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa094b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486246656:12345-0@lo:400:kworker.0 Request processed in 3971us (5010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855761.028245:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787855761.030398:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486246912 00000100:00100000:2.0:1787855761.030434:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486246912 00000100:00100000:2.0:1787855761.030534:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787855761.030550:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486246912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855761.030899:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa096d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486246656:0@lo:400:kworker.0 00000100:00100000:0.0:1787855761.030937:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa095a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486246784:0@lo:400:kworker.0 00000100:00080000:0.0:1787855761.030984:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787855761.030990:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855761.031992:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486246912:12345-0@lo:400:kworker.0 Request processed in 1434us (7306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855761.032621:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa094780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486246912:0@lo:400:kworker.0 00000100:00100000:2.0:1787855761.033249:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1787855761.152046:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787855761.443540:0:9324:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.82 00000100:00100000:0.0:1787855761.541454:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d137a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486247168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787855761.541539:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855761.541635:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486247168 00000100:00100000:0.0:1787855761.541643:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486247168 00000100:00100000:0.0:1787855761.541689:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787855761.541699:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486247168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787855761.541737:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855761.541819:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486247168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855761.541828:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787855761.543236:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d137a1c0 x1874702486247168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855761.543272:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d137a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486247168:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787855762.172323:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855763.196943:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855764.220022:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787855764.923306:0:9423:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.82 00010000:00010000:2.0:1787855765.252484:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855765.415928:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855765.415977:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855765.416137:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464196736 00000100:00100000:1.0:1787855765.416147:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464196736 00000100:00100000:0.0:1787855765.416191:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464196608 00000100:00100000:0.0:1787855765.416196:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464196608 00000100:00100000:1.0:1787855765.416233:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:0.0:1787855765.416234:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 197 00000100:00100000:0.0:1787855765.416243:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2357:x1874702464196608:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855765.416244:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464196736:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855765.416312:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464196736:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 71us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855765.416320:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00080000:3.0:1787855765.416447:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855765.427068:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2357:x1874702464196608:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 10812us (11135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855765.427084:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 197 00000100:00100000:2.0:1787855765.628168:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1379e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486247296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787855765.628250:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855765.628446:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486247296 00000100:00100000:0.0:1787855765.628454:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486247296 00000100:00100000:0.0:1787855765.628518:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787855765.628527:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7648f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486247296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787855765.628564:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855765.628626:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7648f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486247296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855765.628633:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787855765.628670:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d1379e00 x1874702486247296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855765.628689:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1379e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486247296:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787855765.628809:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787855766.147116:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9de6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486247424:0@lo:400:kworker.0 00000100:00100000:3.0:1787855766.147201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855766.147247:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9de6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486247936:0@lo:400:kworker.0 00000100:00100000:3.0:1787855766.147414:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855766.147443:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787855766.147449:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9de52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486247552:0@lo:400:kworker.0 00000100:00100000:3.0:1787855766.147474:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855766.147510:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9de43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486247680:0@lo:400:kworker.0 00000100:00100000:3.0:1787855766.147532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855766.147549:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787855766.147555:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9de7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486247808:0@lo:400:kworker.0 00000100:00100000:3.0:1787855766.147653:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855766.147684:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486247424 00000100:00100000:3.0:1787855766.147691:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486247424 00000100:00100000:3.0:1787855766.147733:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787855766.147742:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c446b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3306:x1874702486247424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855766.147817:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c446b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3306:x1874702486247424:12345-0@lo:400:kworker.0 Request processed in 76us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855766.147825:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787855766.147854:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486247936 00000100:00100000:3.0:1787855766.147858:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486247936 00000100:00100000:3.0:1787855766.147962:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787855766.148097:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486247936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855766.148129:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486247936:12345-0@lo:400:kworker.0 Request processed in 35us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855766.148135:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787855766.148151:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486247552 00000100:00100000:3.0:1787855766.148154:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486247552 00000100:00100000:3.0:1787855766.148187:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486247680 00000100:00100000:3.0:1787855766.148189:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486247680 00000100:00100000:3.0:1787855766.148202:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486247808 00000100:00100000:3.0:1787855766.148204:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486247808 00000100:00100000:3.0:1787855766.148216:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787855766.148223:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486247552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855766.148249:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486247552:12345-0@lo:400:kworker.0 Request processed in 26us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855766.148254:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787855766.148264:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787855766.148535:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486247680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855766.148645:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486247680:12345-0@lo:400:kworker.0 Request processed in 113us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855766.148651:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787855766.148663:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787855766.148668:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486247808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855766.148692:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486247808:12345-0@lo:400:kworker.0 Request processed in 24us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855766.148697:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787855766.148733:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9de52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486247552:0@lo:400:kworker.0 00000100:00100000:3.0:1787855766.148743:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9de6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486247424:0@lo:400:kworker.0 00010000:00080000:3.0:1787855766.148756:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73f9de6d00 x1874702486247936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855766.148765:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9de6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486247936:0@lo:400:kworker.0 00000100:00100000:3.0:1787855766.148819:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9de7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486247808:0@lo:400:kworker.0 00000100:00100000:3.0:1787855766.148829:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9de43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486247680:0@lo:400:kworker.0 00000100:00080000:3.0:1787855766.148851:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787855766.148855:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787855766.268899:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855766.651993:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787855766.652026:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1379e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486248064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787855766.652119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855766.652309:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486248064 00000100:00100000:0.0:1787855766.652319:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486248064 00000100:00100000:0.0:1787855766.652383:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787855766.652395:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486248064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787855766.652443:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855766.652552:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486248064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855766.652558:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787855766.657662:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d1379e00 x1874702486248064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855766.657703:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1379e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486248064:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787855766.986692:0:9471:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 14:36:05 EDT 2026 00010000:00010000:0.0:1787855767.297502:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855768.317863:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855769.340899:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855770.364961:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855770.536135:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855770.536180:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855770.536259:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464196864 00000100:00100000:1.0:1787855770.536269:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464196864 00000100:00100000:1.0:1787855770.536328:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 199 00000100:00100000:1.0:1787855770.536338:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c446a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2359:x1874702464196864:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855770.536421:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c446a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2359:x1874702464196864:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 84us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855770.536429:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 199 00000100:00100000:3.0:1787855770.536742:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464196992 00000100:00100000:3.0:1787855770.536746:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464196992 00000100:00100000:3.0:1787855770.536895:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:3.0:1787855770.536905:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7648780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2359:x1874702464196992:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855770.536951:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7648780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2359:x1874702464196992:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 49us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855770.536958:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00080000:0.0:1787855770.537066:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855770.750144:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9de7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486248192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787855770.750289:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855770.750526:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486248192 00000100:00100000:3.0:1787855770.750534:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486248192 00000100:00100000:3.0:1787855770.750587:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787855770.750598:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486248192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787855770.751086:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855770.751156:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486248192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 560us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855770.751163:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787855770.751673:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787855770.751711:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73f9de7c00 x1874702486248192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855770.751731:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9de7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486248192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787855771.260422:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486248320:0@lo:400:kworker.0 00000100:00100000:0.0:1787855771.260517:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855771.260575:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa096580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486248448:0@lo:400:kworker.0 00000100:00100000:3.0:1787855771.260608:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855771.260613:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486248832:0@lo:400:kworker.0 00000100:00100000:3.0:1787855771.260628:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa097840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486248960:0@lo:400:kworker.0 00000100:00100000:0.0:1787855771.260634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855771.260651:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855771.260659:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787855771.260664:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486248704:0@lo:400:kworker.0 00000100:00100000:3.0:1787855771.260667:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787855771.260672:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa095680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486248576:0@lo:400:kworker.0 00000100:00100000:0.0:1787855771.260684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855771.260688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855771.260711:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486248832 00000100:00100000:0.0:1787855771.260711:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486248448 00000100:00100000:3.0:1787855771.260717:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486248832 00000100:00100000:0.0:1787855771.260717:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486248448 00000100:00100000:0.0:1787855771.260752:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486248576 00000100:00100000:0.0:1787855771.260755:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486248576 00000100:00100000:3.0:1787855771.260758:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787855771.260766:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486248832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855771.260768:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787855771.260796:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787855771.260811:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486248960 00000100:00100000:0.0:1787855771.260814:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486248960 00000100:00100000:0.0:1787855771.260837:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486248704 00000100:00100000:3.0:1787855771.260838:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486248832:12345-0@lo:400:kworker.0 Request processed in 72us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855771.260840:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486248704 00000100:00100000:3.0:1787855771.260855:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787855771.260858:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787855771.260863:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486248960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855771.260869:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787855771.260874:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486248448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855771.260898:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486248448:12345-0@lo:400:kworker.0 Request processed in 23us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855771.260898:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486248960:12345-0@lo:400:kworker.0 Request processed in 34us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855771.260904:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787855771.260904:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787855771.260916:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787855771.260916:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787855771.260922:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486248576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855771.260922:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486248704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855771.260947:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486248576:12345-0@lo:400:kworker.0 Request processed in 25us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855771.260947:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486248704:12345-0@lo:400:kworker.0 Request processed in 25us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855771.260953:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787855771.260953:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787855771.260986:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787855771.260991:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855771.261131:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa095680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486248576:0@lo:400:kworker.0 00000100:00100000:0.0:1787855771.261154:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa096580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486248448:0@lo:400:kworker.0 00010000:00080000:0.0:1787855771.261166:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73fa097840 x1874702486248960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855771.261176:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa097840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486248960:0@lo:400:kworker.0 00010000:00080000:0.0:1787855771.261205:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73fa0961c0 x1874702486248704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855771.261213:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486248704:0@lo:400:kworker.0 00000100:00100000:0.0:1787855771.261223:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486248832:0@lo:400:kworker.0 00000100:00100000:1.0:1787855771.261567:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486248320 00000100:00100000:1.0:1787855771.261573:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486248320 00000100:00100000:1.0:1787855771.261658:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787855771.261668:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486248320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855771.261727:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486248320:12345-0@lo:400:kworker.0 Request processed in 62us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855771.261733:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787855771.261802:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486248320:0@lo:400:kworker.0 00010000:00010000:0.0:1787855771.388098:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855771.775247:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787855771.775269:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d137bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486249088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787855771.775340:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855771.775797:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486249088 00000100:00100000:0.0:1787855771.775806:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486249088 00000100:00100000:0.0:1787855771.775869:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787855771.775880:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7649680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486249088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787855771.775915:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855771.775971:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7649680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486249088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855771.775978:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787855771.776151:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d137bc00 x1874702486249088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855771.776168:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d137bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486249088:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787855772.412163:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855773.441294:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855774.461210:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855775.487409:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855775.656957:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855775.657038:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855775.657493:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464197248 00000100:00100000:3.0:1787855775.657506:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464197248 00000100:00100000:3.0:1787855775.657625:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:3.0:1787855775.657639:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464197248:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855775.657745:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464197248:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 108us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855775.657753:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00080000:1.0:1787855775.658051:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855775.658583:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464197120 00000100:00100000:0.0:1787855775.658592:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464197120 00000100:00100000:0.0:1787855775.658663:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 201 00000100:00100000:0.0:1787855775.658693:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2360:x1874702464197120:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855775.658749:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2360:x1874702464197120:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 58us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855775.658757:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 201 00000100:00100000:0.0:1787855775.869893:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787855775.869925:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d137b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486249216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787855775.870035:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855775.870133:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486249216 00000100:00100000:0.0:1787855775.870153:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486249216 00000100:00100000:0.0:1787855775.870229:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787855775.870240:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486249216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787855775.870288:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855775.870343:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486249216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855775.870351:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787855775.870398:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d137b840 x1874702486249216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855775.870419:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d137b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486249216:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787855775.871519:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787855776.380446:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787855776.380485:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c97330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486249728:0@lo:400:kworker.0 00000100:00100000:3.0:1787855776.380509:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9733840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486249600:0@lo:400:kworker.0 00000100:00100000:0.0:1787855776.380677:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9730f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486249856:0@lo:400:kworker.0 00000100:00100000:1.0:1787855776.380724:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9de7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486249472:0@lo:400:kworker.0 00000100:00100000:2.0:1787855776.384759:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855776.384862:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9de43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486249344:0@lo:400:kworker.0 00000100:00100000:2.0:1787855776.384916:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855776.384977:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486249728 00000100:00100000:2.0:1787855776.384984:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486249728 00000100:00100000:2.0:1787855776.385118:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787855776.385128:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486249728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855776.385185:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486249728:12345-0@lo:400:kworker.0 Request processed in 58us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855776.385191:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787855776.385214:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486249344 00000100:00100000:2.0:1787855776.385218:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486249344 00000100:00100000:2.0:1787855776.385242:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787855776.385248:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486249344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855776.385279:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486249344:12345-0@lo:400:kworker.0 Request processed in 31us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855776.385285:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00080000:2.0:1787855776.385340:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73c97330c0 x1874702486249728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855776.385354:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c97330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486249728:0@lo:400:kworker.0 00000100:00100000:2.0:1787855776.385364:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9de43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486249344:0@lo:400:kworker.0 00000100:00100000:0.0:1787855776.389112:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855776.389729:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486249856 00000100:00100000:2.0:1787855776.389744:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486249856 00000100:00100000:2.0:1787855776.389879:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787855776.389896:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486249856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855776.390045:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486249856:12345-0@lo:400:kworker.0 Request processed in 156us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855776.390053:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1787855776.394444:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855776.394520:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9730f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486249856:0@lo:400:kworker.0 00000100:00100000:1.0:1787855776.396497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855776.396940:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486249984:0@lo:400:kworker.0 00000100:00100000:1.0:1787855776.397016:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855776.397667:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855776.398516:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486249984 00000100:00100000:0.0:1787855776.398533:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486249984 00000100:00100000:0.0:1787855776.398644:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787855776.398674:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa095a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486249984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855776.398826:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa095a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486249984:12345-0@lo:400:kworker.0 Request processed in 154us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855776.398835:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787855776.401308:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787855776.401405:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73c9730000 x1874702486249984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855776.401427:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486249984:0@lo:400:kworker.0 00000100:00100000:2.0:1787855776.418848:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486249472 00000100:00100000:2.0:1787855776.418870:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486249472 00000100:00100000:2.0:1787855776.418987:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486249600 00000100:00100000:2.0:1787855776.419002:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486249600 00000100:00100000:0.0:1787855776.423568:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787855776.423615:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa094780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486249472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855776.423801:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa094780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486249472:12345-0@lo:400:kworker.0 Request processed in 216us (27313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855776.423810:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787855776.423837:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787855776.423846:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9732580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486249600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855776.423924:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9732580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486249600:12345-0@lo:400:kworker.0 Request processed in 80us (26260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855776.423930:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787855776.424023:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9de7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486249472:0@lo:400:kworker.0 00000100:00100000:0.0:1787855776.424094:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9733840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486249600:0@lo:400:kworker.0 00000100:00080000:1.0:1787855776.425714:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787855776.514309:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855776.894967:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9731a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486250112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787855776.895119:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855776.895219:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486250112 00000100:00100000:3.0:1787855776.895232:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486250112 00000100:00100000:3.0:1787855776.895338:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787855776.895350:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa096d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486250112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787855776.895563:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855776.895624:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa096d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486250112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 276us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855776.895633:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787855776.895647:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73c9731a40 x1874702486250112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855776.895675:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9731a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486250112:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787855777.540962:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855778.556123:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855779.589964:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855780.605364:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855780.773367:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855780.773424:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855780.773572:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464197376 00000100:00100000:3.0:1787855780.773583:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464197376 00000100:00100000:3.0:1787855780.773653:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 203 00000100:00100000:3.0:1787855780.773664:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2359:x1874702464197376:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855780.773753:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2359:x1874702464197376:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 91us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855780.773760:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 203 00000100:00100000:0.0:1787855780.774059:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464197504 00000100:00100000:0.0:1787855780.774064:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464197504 00000100:00100000:0.0:1787855780.774119:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:0.0:1787855780.774127:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2359:x1874702464197504:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855780.774175:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2359:x1874702464197504:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 49us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855780.774182:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00080000:2.0:1787855780.774245:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855780.987970:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787855780.988011:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1379e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486250240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787855780.988097:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855780.988171:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486250240 00000100:00100000:0.0:1787855780.988180:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486250240 00000100:00100000:0.0:1787855780.988239:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787855780.988248:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1378780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486250240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787855780.988292:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855780.988352:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1378780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486250240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855780.988360:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787855780.988384:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787855780.988414:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d1379e00 x1874702486250240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855780.988432:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1379e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486250240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855781.500978:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9730b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486250752:0@lo:400:kworker.0 00000100:00100000:3.0:1787855781.501073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855781.501138:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787855781.501146:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9730780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486250368:0@lo:400:kworker.0 00000100:00100000:3.0:1787855781.501177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855781.501201:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9732940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486250880:0@lo:400:kworker.0 00000100:00100000:3.0:1787855781.501226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855781.501254:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9731680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486250496:0@lo:400:kworker.0 00000100:00100000:3.0:1787855781.501278:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855781.501295:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c97312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486251008:0@lo:400:kworker.0 00000100:00100000:3.0:1787855781.501332:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855781.501352:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787855781.501357:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9731e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486250624:0@lo:400:kworker.0 00000100:00100000:3.0:1787855781.501380:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855781.501411:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486250752 00000100:00100000:3.0:1787855781.501418:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486250752 00000100:00100000:3.0:1787855781.501466:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486251008 00000100:00100000:3.0:1787855781.501469:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486251008 00000100:00100000:3.0:1787855781.501519:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787855781.501529:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c97303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486250752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855781.501581:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c97303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486250752:12345-0@lo:400:kworker.0 Request processed in 53us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855781.501588:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787855781.501604:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787855781.501610:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486251008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855781.501643:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486251008:12345-0@lo:400:kworker.0 Request processed in 33us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855781.501648:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787855781.501665:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486250368 00000100:00100000:3.0:1787855781.501669:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486250368 00000100:00100000:3.0:1787855781.501692:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787855781.501699:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486250368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855781.501727:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486250368:12345-0@lo:400:kworker.0 Request processed in 29us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855781.501733:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787855781.501759:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486250880 00000100:00100000:3.0:1787855781.501763:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486250880 00000100:00100000:3.0:1787855781.501817:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486250496 00000100:00100000:3.0:1787855781.501821:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486250496 00000100:00100000:3.0:1787855781.501833:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486250624 00000100:00100000:3.0:1787855781.501835:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486250624 00000100:00100000:3.0:1787855781.501853:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787855781.501859:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9733c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486250880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855781.501892:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9733c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486250880:12345-0@lo:400:kworker.0 Request processed in 33us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855781.501898:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787855781.501926:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787855781.501933:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9732d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486250496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855781.501962:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9732d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486250496:12345-0@lo:400:kworker.0 Request processed in 30us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855781.501968:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787855781.501979:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787855781.501984:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c97321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486250624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855781.502011:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c97321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486250624:12345-0@lo:400:kworker.0 Request processed in 27us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855781.502017:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1787855781.502046:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787855781.502051:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787855781.502087:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9731e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486250624:0@lo:400:kworker.0 00000100:00100000:3.0:1787855781.502100:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9731680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486250496:0@lo:400:kworker.0 00010000:00080000:3.0:1787855781.502111:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73c97312c0 x1874702486251008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855781.502122:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c97312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486251008:0@lo:400:kworker.0 00000100:00100000:3.0:1787855781.502165:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9730780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486250368:0@lo:400:kworker.0 00000100:00100000:3.0:1787855781.502176:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9732940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486250880:0@lo:400:kworker.0 00010000:00080000:3.0:1787855781.502186:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73c9730b40 x1874702486250752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855781.502195:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9730b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486250752:0@lo:400:kworker.0 00010000:00010000:3.0:1787855781.628091:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855782.013686:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d137a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486251136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787855782.013744:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855782.013809:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486251136 00000100:00100000:0.0:1787855782.013815:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486251136 00000100:00100000:0.0:1787855782.013847:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787855782.013853:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1379a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486251136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787855782.013881:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855782.013935:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1379a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486251136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855782.013942:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787855782.013982:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d137a1c0 x1874702486251136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855782.014014:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d137a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486251136:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787855782.661229:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855783.677472:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855784.700590:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787855785.679617:0:10104:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:36:24 (1787855784) === 00010000:00010000:3.0:1787855785.733982:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855785.898386:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855785.898466:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464197760 00000100:00100000:1.0:1787855785.898474:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855785.898488:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464197760 00000100:00080000:0.0:1787855785.898547:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855785.898579:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:3.0:1787855785.898593:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2358:x1874702464197760:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855785.898683:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2358:x1874702464197760:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 94us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855785.898692:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:2.0:1787855785.898806:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464197632 00000100:00100000:2.0:1787855785.898811:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464197632 00000100:00100000:2.0:1787855785.898851:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 205 00000100:00100000:2.0:1787855785.898858:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2358:x1874702464197632:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855785.898900:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2358:x1874702464197632:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 42us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855785.898908:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 205 00000100:00100000:3.0:1787855786.108182:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d137b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486251264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855786.108243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855786.108524:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486251264 00000100:00100000:1.0:1787855786.108534:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486251264 00000100:00100000:1.0:1787855786.108604:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787855786.108614:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9732940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486251264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787855786.108651:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787855786.109102:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787855786.111238:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9732940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486251264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2617us (2985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855786.111251:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1787855786.115200:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d137b0c0 x1874702486251264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855786.115231:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d137b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486251264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787855786.218962:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855786.219182:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464197888 00000100:00100000:0.0:1787855786.219192:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464197888 00000100:00100000:0.0:1787855786.219252:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 206 00000100:00100000:0.0:1787855786.219263:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:8125:x1874702464197888:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787855786.219280:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855786.219300:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c5143200/0x516929ca3366d684 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616a3d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855786.219328:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c5143200/0x516929ca3366d684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a3d expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855786.219339:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c5143200/0x516929ca3366d684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a3d expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855786.219347:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143200, rc 0) 00000100:00100000:0.0:1787855786.219408:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:8125:x1874702464197888:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 147us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855786.219415:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 206 00000100:00100000:2.0:1787855786.229243:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855786.229330:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464198016 00000100:00100000:3.0:1787855786.229342:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464198016 00000100:00100000:3.0:1787855786.229403:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 207 00000100:00100000:3.0:1787855786.229415:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:8125:x1874702464198016:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787855786.229738:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:8125:x1874702464198016:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 324us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855786.229754:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 207 00000100:00100000:1.0:1787855786.231520:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855786.231724:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464198144 00000100:00100000:2.0:1787855786.231732:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464198144 00000100:00100000:2.0:1787855786.231814:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 208 00000100:00100000:2.0:1787855786.231834:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:8125:x1874702464198144:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787855786.232270:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:8125:x1874702464198144:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 447us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855786.232279:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 208 00000100:00100000:1.0:1787855786.234999:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855786.235187:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464198272 00000100:00100000:0.0:1787855786.235213:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464198272 00000100:00100000:0.0:1787855786.235276:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 209 00000100:00100000:0.0:1787855786.235286:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:8129:x1874702464198272:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787855786.235852:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:8129:x1874702464198272:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 565us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855786.235861:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 209 00000100:00100000:0.0:1787855786.258233:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855786.258311:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464198400 00000100:00100000:2.0:1787855786.258318:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464198400 00000100:00100000:2.0:1787855786.258374:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 210 00000100:00100000:2.0:1787855786.258382:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:8129:x1874702464198400:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787855786.258744:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:8129:x1874702464198400:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 362us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855786.258750:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 210 00000100:00100000:1.0:1787855786.271909:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855786.272835:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464198528 00000100:00100000:0.0:1787855786.272848:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464198528 00000100:00100000:0.0:1787855786.272927:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 211 00000100:00100000:0.0:1787855786.272938:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:8125:x1874702464198528:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787855786.272956:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855786.273099:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d68b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616a67 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855786.273130:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d68b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a67 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855786.273142:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d68b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a67 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855786.273151:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143c00, rc 0) 00000100:00100000:0.0:1787855786.273225:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:8125:x1874702464198528:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 289us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855786.273232:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 211 00000100:00100000:1.0:1787855786.281671:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855786.282709:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464198656 00000100:00100000:2.0:1787855786.282721:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464198656 00000100:00100000:2.0:1787855786.282852:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 212 00000100:00100000:2.0:1787855786.282864:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:8125:x1874702464198656:12345-192.168.201.38@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787855786.282891:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787855786.283037:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787855786.283042:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787855786.283046:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787855786.283049:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787855786.285402:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:8125:x1874702464198656:12345-192.168.201.38@tcp:256:mount.lustre.0 Request processed in 2529us (3727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855786.285418:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 212 00000100:00100000:1.0:1787855786.301552:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855786.301802:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464198784 00000100:00100000:3.0:1787855786.301813:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464198784 00000100:00100000:3.0:1787855786.301890:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 213 00000100:00100000:3.0:1787855786.301901:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:8125:x1874702464198784:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787855786.301919:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855786.301936:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73d1228600/0x516929ca3366d692 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616a6e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855786.301977:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1228600/0x516929ca3366d692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a6e expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855786.301991:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73d1228600/0x516929ca3366d692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a6e expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855786.301998:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228600, rc 0) 00000100:00100000:3.0:1787855786.302120:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:8125:x1874702464198784:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 221us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855786.302127:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 213 00000100:00100000:0.0:1787855786.317195:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855786.317506:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464198912 00000100:00100000:1.0:1787855786.317530:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464198912 00000100:00100000:1.0:1787855786.317616:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 214 00000100:00100000:1.0:1787855786.317626:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:8125:x1874702464198912:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787855786.317974:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:8125:x1874702464198912:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 348us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855786.317983:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 214 00000100:00100000:2.0:1787855786.322139:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855786.322263:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464199040 00000100:00100000:3.0:1787855786.322274:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464199040 00000100:00100000:3.0:1787855786.324165:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 215 00000100:00100000:3.0:1787855786.324190:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:8125:x1874702464199040:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787855786.324441:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:8125:x1874702464199040:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 263us (2311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855786.324449:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 215 00000100:00100000:2.0:1787855786.331391:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855786.332986:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464199168 00000100:00100000:1.0:1787855786.333000:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464199168 00000100:00100000:1.0:1787855786.333077:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 216 00000100:00100000:1.0:1787855786.333089:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:8133:x1874702464199168:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787855786.333354:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:8133:x1874702464199168:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 266us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855786.333363:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 216 00000100:00100000:1.0:1787855786.346898:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855786.346996:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464199296 00000100:00100000:3.0:1787855786.347006:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464199296 00000100:00100000:3.0:1787855786.347065:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 217 00000100:00100000:3.0:1787855786.347074:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:8133:x1874702464199296:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787855786.347580:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:8133:x1874702464199296:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 506us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855786.347590:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 217 00000100:00100000:2.0:1787855786.357909:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855786.358001:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855786.371150:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464199424 00000100:00100000:3.0:1787855786.371166:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464199424 00000100:00100000:0.0:1787855786.372328:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464199808 00000100:00100000:0.0:1787855786.372351:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464199808 00000100:00100000:1.0:1787855786.372425:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:1.0:1787855786.372437:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464199808:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855786.372538:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464199808:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 103us (14536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855786.372546:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:1.0:1787855786.372564:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:1.0:1787855786.372569:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2356:x1874702464199424:12345-192.168.201.38@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787855786.372593:0:5833:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 76a6c3f7-1d4d-422f-86c9-d52d89a6ee45@192.168.201.38@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:1.0:1787855786.372630:0:5833:0:(genops.c:1385:class_connect()) connect: client 76a6c3f7-1d4d-422f-86c9-d52d89a6ee45, cookie 0x516929ca3366d699 00000004:00100000:1.0:1787855786.372664:0:5833:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787855786.373440:0:5833:0:(import.c:65:import_set_state_nolock()) ffff9a72c1b21800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787855786.373513:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:2356:x1874702464199424:12345-192.168.201.38@tcp:38:mount.lustre.0 Request processed in 941us (15617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855786.373521:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:2.0:1787855786.377974:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855786.378128:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855786.378437:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464199680 00000100:00100000:1.0:1787855786.378448:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464199680 00000100:00100000:1.0:1787855786.378524:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464199552 00000100:00100000:1.0:1787855786.378528:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464199552 00000100:00100000:1.0:1787855786.378550:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:1.0:1787855786.378561:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+7:8125:x1874702464199680:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787855786.378604:0:9629:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787855786.378687:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+7:8125:x1874702464199680:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 128us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855786.378694:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:1.0:1787855786.378712:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:1.0:1787855786.378720:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:0:x1874702464199552:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787855786.378730:0:9629:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787855786.378751:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:0:x1874702464199552:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 32us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855786.378757:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00080000:2.0:1787855786.378851:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855786.381307:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855786.381385:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464199936 00000100:00100000:2.0:1787855786.381394:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464199936 00000100:00100000:2.0:1787855786.381458:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:2.0:1787855786.381468:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9730780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:8125:x1874702464199936:12345-192.168.201.38@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787855786.381559:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9730780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:8125:x1874702464199936:12345-192.168.201.38@tcp:40:mount.lustre.0 Request processed in 92us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855786.381586:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:3.0:1787855786.388827:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855786.388902:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855786.388987:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464200064 00000100:00100000:2.0:1787855786.388996:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464200064 00000100:00100000:2.0:1787855786.389045:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:2.0:1787855786.389054:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c97312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1874702464200064:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787855786.389085:0:8077:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 76a6c3f7-1d4d-422f-86c9-d52d89a6ee45@192.168.201.38@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:2.0:1787855786.389114:0:8077:0:(genops.c:1385:class_connect()) connect: client 76a6c3f7-1d4d-422f-86c9-d52d89a6ee45, cookie 0x516929ca3366d6a0 00000100:00100000:3.0:1787855786.389122:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00002000:00100000:2.0:1787855786.389126:0:8077:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 76a6c3f7-1d4d-422f-86c9-d52d89a6ee45/ffff9a73f743c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787855786.389137:0:8077:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787855786.389163:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464200320 00000100:00100000:3.0:1787855786.389168:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464200320 00000100:00100000:3.0:1787855786.389198:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:3.0:1787855786.389204:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9731e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:8125:x1874702464200320:12345-192.168.201.38@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787855786.389376:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787855786.389531:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9731e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:8125:x1874702464200320:12345-192.168.201.38@tcp:33:mount.lustre.0 Request processed in 325us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855786.389540:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00002000:00080000:2.0:1787855786.389557:0:8077:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787855786.389584:0:8077:0:(import.c:65:import_set_state_nolock()) ffff9a73f743e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787855786.389613:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c97312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:2356:x1874702464200064:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 559us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855786.389619:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:2.0:1787855786.389630:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464200192 00000100:00100000:2.0:1787855786.389633:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464200192 00000100:00100000:2.0:1787855786.389651:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:2.0:1787855786.389656:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9731680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1874702464200192:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787855786.389671:0:8077:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 76a6c3f7-1d4d-422f-86c9-d52d89a6ee45@192.168.201.38@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:2.0:1787855786.389688:0:8077:0:(genops.c:1385:class_connect()) connect: client 76a6c3f7-1d4d-422f-86c9-d52d89a6ee45, cookie 0x516929ca3366d6a7 00002000:00100000:2.0:1787855786.389693:0:8077:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 76a6c3f7-1d4d-422f-86c9-d52d89a6ee45/ffff9a73f743c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787855786.389710:0:8077:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787855786.389883:0:8077:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787855786.389897:0:8077:0:(import.c:65:import_set_state_nolock()) ffff9a73f743f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787855786.389993:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9731680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:2356:x1874702464200192:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 335us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855786.390000:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:1.0:1787855786.620209:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486251648:0@lo:400:kworker.0 00000100:00100000:3.0:1787855786.620260:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486251520:0@lo:400:kworker.0 00000100:00100000:1.0:1787855786.620283:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855786.620293:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa097840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486251776:0@lo:400:kworker.0 00000100:00100000:3.0:1787855786.620317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855786.620382:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486251392:0@lo:400:kworker.0 00000100:00100000:0.0:1787855786.620410:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486251776 00000100:00100000:2.0:1787855786.620414:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855786.620417:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486251776 00000100:00100000:2.0:1787855786.620445:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486251392 00000100:00100000:2.0:1787855786.620448:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486251392 00000100:00100000:0.0:1787855786.620463:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787855786.620471:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9731a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486251776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855786.620472:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787855786.620476:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486251392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855786.620516:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486251392:12345-0@lo:400:kworker.0 Request processed in 37us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855786.620516:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9731a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486251776:12345-0@lo:400:kworker.0 Request processed in 45us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855786.620523:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1787855786.620523:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787855786.620545:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486251648 00000100:00100000:0.0:1787855786.620548:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486251648 00000100:00080000:2.0:1787855786.620566:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855786.620579:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787855786.620583:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855786.620585:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486251648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855786.620613:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486251648:12345-0@lo:400:kworker.0 Request processed in 28us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855786.620616:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486251520 00000100:00100000:2.0:1787855786.620619:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486251520 00000100:00100000:0.0:1787855786.620620:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787855786.620638:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787855786.620643:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486251520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855786.620674:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486251520:12345-0@lo:400:kworker.0 Request processed in 31us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855786.620683:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486251648:0@lo:400:kworker.0 00000100:00100000:3.0:1787855786.621666:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486251392:0@lo:400:kworker.0 00000100:00100000:3.0:1787855786.621696:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa096580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486251904:0@lo:400:kworker.0 00000100:00100000:3.0:1787855786.621735:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855786.621842:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486251520:0@lo:400:kworker.0 00000100:00100000:3.0:1787855786.621849:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa095680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486252032:0@lo:400:kworker.0 00000100:00100000:3.0:1787855786.621874:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855786.622028:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486252032 00000100:00100000:1.0:1787855786.622034:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486252032 00000100:00100000:1.0:1787855786.622091:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787855786.622100:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486252032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855786.622146:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486252032:12345-0@lo:400:kworker.0 Request processed in 48us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855786.622153:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787855786.622172:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787855786.622182:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486251904 00000100:00100000:1.0:1787855786.622185:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486251904 00000100:00080000:1.0:1787855786.622200:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787855786.622232:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73fa097840 x1874702486251776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855786.622244:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa097840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486251776:0@lo:400:kworker.0 00010000:00080000:3.0:1787855786.622271:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73fa095680 x1874702486252032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855786.622279:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa095680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486252032:0@lo:400:kworker.0 00000100:00100000:0.0:1787855786.626586:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787855786.630286:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787855786.630702:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9733840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486251904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855786.630839:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9733840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486251904:12345-0@lo:400:kworker.0 Request processed in 540us (9102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855786.630847:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787855786.631031:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa096580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486251904:0@lo:400:kworker.0 00010000:00010000:3.0:1787855786.748088:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855787.134195:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787855787.134221:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d137b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486252160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787855787.134300:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855787.134665:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486252160 00000100:00100000:0.0:1787855787.134673:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486252160 00000100:00100000:0.0:1787855787.134726:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787855787.134735:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9730f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486252160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787855787.134756:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855787.134851:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9730f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486252160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855787.134874:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787855787.134955:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d137b0c0 x1874702486252160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855787.134973:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d137b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486252160:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787855787.188033:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76a6c3f7-1d4d-422f-86c9-d52d89a6ee45 00010000:00010000:0.0:1787855787.774738:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855788.799875:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787855789.775580:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 76a6c3f7-1d4d-422f-86c9-d52d89a6ee45 00010000:00010000:3.0:1787855789.822819:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787855790.295164:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 76a6c3f7-1d4d-422f-86c9-d52d89a6ee45 00010000:00010000:2.0:1787855790.849445:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855791.229743:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787855791.235716:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d137a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486252288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787855791.236365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855791.240511:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486252288 00000100:00100000:0.0:1787855791.240546:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486252288 00000100:00100000:0.0:1787855791.240670:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787855791.240684:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa096580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486252288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787855791.240748:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855791.240924:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa096580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486252288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 243us (4562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855791.240933:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787855791.241230:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d137a1c0 x1874702486252288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855791.241292:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d137a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486252288:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787855791.243071:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787855791.528216:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855791.528272:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855791.528304:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855791.528366:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855791.528402:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855791.528953:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464200960 00000100:00100000:0.0:1787855791.528967:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464200960 00000100:00100000:0.0:1787855791.529068:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464200832 00000100:00100000:0.0:1787855791.529072:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464200832 00000100:00100000:0.0:1787855791.529104:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:0.0:1787855791.529117:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9730b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2358:x1874702464200960:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855791.529218:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9730b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2358:x1874702464200960:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 104us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855791.529227:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:0.0:1787855791.529249:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:0.0:1787855791.529256:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2358:x1874702464200832:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855791.529283:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2358:x1874702464200832:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855791.529289:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:0.0:1787855791.529325:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464200704 00000100:00100000:0.0:1787855791.529329:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464200704 00000100:00100000:0.0:1787855791.529359:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464200576 00000100:00100000:0.0:1787855791.529363:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464200576 00000100:00100000:0.0:1787855791.529387:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:0.0:1787855791.529393:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c97330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2358:x1874702464200704:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855791.529425:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c97330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2358:x1874702464200704:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 32us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855791.529432:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:0.0:1787855791.529444:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:0.0:1787855791.529451:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400694f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2358:x1874702464200576:12345-192.168.201.38@tcp:400:kworker.0 00000100:00080000:3.0:1787855791.529547:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787855791.529555:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787855791.529558:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787855791.530055:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400694f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2358:x1874702464200576:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 602us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855791.530064:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:1.0:1787855791.530978:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464200448 00000100:00100000:1.0:1787855791.530991:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464200448 00000100:00100000:1.0:1787855791.531058:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 219 00000100:00100000:1.0:1787855791.531071:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2358:x1874702464200448:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855791.531138:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2358:x1874702464200448:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 69us (2937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855791.531146:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 219 00000100:00100000:1.0:1787855791.740381:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486252672:0@lo:400:kworker.0 00000100:00100000:1.0:1787855791.740506:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855791.740628:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787855791.740635:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486252544:0@lo:400:kworker.0 00000100:00100000:1.0:1787855791.740659:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855791.740835:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486252800:0@lo:400:kworker.0 00000100:00100000:0.0:1787855791.740870:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855791.740903:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787855791.740909:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486252416:0@lo:400:kworker.0 00000100:00100000:0.0:1787855791.740946:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855791.740972:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486252928:0@lo:400:kworker.0 00000100:00100000:0.0:1787855791.740999:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855791.741031:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486252416 00000100:00100000:0.0:1787855791.741040:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486252416 00000100:00100000:0.0:1787855791.741090:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787855791.741099:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486252416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855791.741159:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486252416:12345-0@lo:400:kworker.0 Request processed in 59us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855791.741177:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787855791.741237:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab83c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486252416:0@lo:400:kworker.0 00000100:00100000:0.0:1787855791.741269:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486252928 00000100:00100000:0.0:1787855791.741273:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486252928 00000100:00100000:0.0:1787855791.741321:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787855791.741328:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1379680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486252928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855791.741367:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1379680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486252928:12345-0@lo:400:kworker.0 Request processed in 39us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855791.741373:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1787855791.741393:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787855791.741415:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73fab80f00 x1874702486252928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855791.741429:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486252928:0@lo:400:kworker.0 00000100:00100000:0.0:1787855791.741449:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486252672 00000100:00100000:0.0:1787855791.741453:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486252672 00000100:00100000:0.0:1787855791.741485:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486252544 00000100:00100000:0.0:1787855791.741488:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486252544 00000100:00100000:0.0:1787855791.741499:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486252800 00000100:00100000:0.0:1787855791.741502:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486252800 00000100:00100000:0.0:1787855791.741517:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787855791.741524:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa095680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486252672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855791.741558:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa095680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486252672:12345-0@lo:400:kworker.0 Request processed in 35us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855791.741564:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787855791.741575:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787855791.741582:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa097840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486252544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855791.741636:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa097840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486252544:12345-0@lo:400:kworker.0 Request processed in 54us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855791.741643:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787855791.741655:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787855791.741662:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1379e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486252800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855791.741694:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1379e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486252800:12345-0@lo:400:kworker.0 Request processed in 33us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855791.741701:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1787855791.741721:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855791.741757:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486252800:0@lo:400:kworker.0 00000100:00100000:1.0:1787855791.742064:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab82d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486252544:0@lo:400:kworker.0 00000100:00100000:1.0:1787855791.742079:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab83840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486252672:0@lo:400:kworker.0 00010000:00010000:3.0:1787855791.868148:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855792.254708:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787855792.254750:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1378b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486253056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787855792.273466:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855792.273566:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486253056 00000100:00100000:2.0:1787855792.273579:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486253056 00000100:00100000:2.0:1787855792.273670:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787855792.273683:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486253056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787855792.273747:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787855792.273842:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486253056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855792.273849:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787855792.278600:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d1378b40 x1874702486253056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855792.278641:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1378b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486253056:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787855792.872252:0:10302:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787855792.892825:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855793.915939:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855794.941245:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855795.965253:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855796.348033:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486253184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787855796.348110:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855796.348235:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486253184 00000100:00100000:1.0:1787855796.348244:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486253184 00000100:00100000:1.0:1787855796.348316:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787855796.348326:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486253184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787855796.348364:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787855796.348591:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486253184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 265us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855796.348599:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787855796.348623:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787855796.348737:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73fa096940 x1874702486253184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855796.348756:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486253184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855796.665131:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855796.665170:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855796.665198:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855796.665225:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855796.665262:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855796.665295:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464201216 00000100:00100000:3.0:1787855796.665304:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464201216 00000100:00100000:3.0:1787855796.665360:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464201344 00000100:00100000:3.0:1787855796.665364:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464201344 00000100:00100000:3.0:1787855796.665389:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:3.0:1787855796.665400:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464201216:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855796.665472:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464201216:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 74us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855796.665480:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:3.0:1787855796.665513:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:3.0:1787855796.665520:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400694780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464201344:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855796.665549:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400694780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464201344:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 31us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855796.665555:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:3.0:1787855796.665582:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464201472 00000100:00100000:3.0:1787855796.665586:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464201472 00000100:00100000:3.0:1787855796.665613:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464201600 00000100:00100000:3.0:1787855796.665616:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464201600 00000100:00100000:3.0:1787855796.665636:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:3.0:1787855796.665654:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400695680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464201472:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855796.665683:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400695680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464201472:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 41us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855796.665689:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:3.0:1787855796.665701:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:3.0:1787855796.665707:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400695e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464201600:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855796.665730:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400695e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464201600:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 23us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855796.665748:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00080000:1.0:1787855796.666369:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787855796.666374:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787855796.666377:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855796.666759:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464201088 00000100:00100000:2.0:1787855796.666767:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464201088 00000100:00100000:2.0:1787855796.666844:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 221 00000100:00100000:2.0:1787855796.666854:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2357:x1874702464201088:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855796.666908:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2357:x1874702464201088:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 56us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855796.666916:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 221 00000100:00100000:2.0:1787855796.861112:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486253568:0@lo:400:kworker.0 00000100:00100000:2.0:1787855796.861183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855796.861284:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787855796.861291:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874702486253696:0@lo:400:kworker.0 00000100:00100000:2.0:1787855796.861315:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855796.861615:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486253312:0@lo:400:kworker.0 00000100:00100000:3.0:1787855796.861797:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486253440:0@lo:400:kworker.0 00000100:00100000:3.0:1787855796.861832:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855796.861867:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486253568 00000100:00100000:3.0:1787855796.861875:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486253568 00000100:00100000:3.0:1787855796.861926:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486253696 00000100:00100000:3.0:1787855796.861930:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486253696 00000100:00100000:3.0:1787855796.861943:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486253440 00000100:00100000:3.0:1787855796.861953:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486253440 00000100:00100000:3.0:1787855796.861969:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787855796.861978:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486253568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855796.862035:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486253568:12345-0@lo:400:kworker.0 Request processed in 57us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855796.862042:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787855796.862058:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787855796.862064:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874702486253696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855796.862089:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874702486253696:12345-0@lo:400:kworker.0 Request processed in 25us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855796.862094:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787855796.862104:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787855796.862109:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400694b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486253440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855796.862135:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400694b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486253440:12345-0@lo:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855796.862140:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1787855796.862160:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855796.862190:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486253440:0@lo:400:kworker.0 00000100:00100000:0.0:1787855796.862439:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855796.862471:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486253824:0@lo:400:kworker.0 00000100:00100000:0.0:1787855796.862497:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855796.862537:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486253312 00000100:00100000:0.0:1787855796.862541:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486253312 00000100:00100000:0.0:1787855796.862569:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787855796.862584:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486253312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855796.862617:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486253312:12345-0@lo:400:kworker.0 Request processed in 35us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855796.863146:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab80780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874702486253696:0@lo:400:kworker.0 00000100:00100000:2.0:1787855796.863161:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486253568:0@lo:400:kworker.0 00000100:00100000:3.0:1787855796.863243:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486253824 00000100:00100000:3.0:1787855796.863248:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486253824 00000100:00100000:3.0:1787855796.863297:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787855796.863304:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1378b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486253824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855796.863344:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1378b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486253824:12345-0@lo:400:kworker.0 Request processed in 41us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855796.863351:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787855796.863505:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787855796.863548:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486253312:0@lo:400:kworker.0 00010000:00080000:0.0:1787855796.863561:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73fab81680 x1874702486253824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855796.863706:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486253824:0@lo:400:kworker.0 00000100:00080000:2.0:1787855796.863915:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787855796.987944:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855797.372061:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787855797.372086:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d137a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486253952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787855797.372162:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855797.372387:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486253952 00000100:00100000:1.0:1787855797.372395:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486253952 00000100:00100000:1.0:1787855797.372449:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787855797.372460:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486253952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787855797.372496:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1787855797.372616:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d137a1c0 x1874702486253952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855797.372647:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d137a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486253952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787855797.372698:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486253952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 239us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855797.372706:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1787855798.013975:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855799.038003:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855800.061342:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855801.084207:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855801.468040:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486254080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787855801.468115:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855801.468357:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486254080 00000100:00100000:1.0:1787855801.468366:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486254080 00000100:00100000:1.0:1787855801.468446:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787855801.468458:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486254080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787855801.468495:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787855801.468545:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486254080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855801.468552:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1787855801.468620:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787855801.468652:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73fa096940 x1874702486254080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855801.468671:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486254080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855801.769074:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855801.769170:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855801.769199:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855801.769219:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855801.769242:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855801.769272:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464201728 00000100:00100000:3.0:1787855801.769282:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464201728 00000100:00100000:3.0:1787855801.769334:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 223 00000100:00100000:3.0:1787855801.769344:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2360:x1874702464201728:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855801.769414:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2360:x1874702464201728:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 72us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855801.769420:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 223 00000100:00100000:3.0:1787855801.769445:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464201984 00000100:00100000:3.0:1787855801.769448:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464201984 00000100:00100000:3.0:1787855801.769512:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464201856 00000100:00100000:3.0:1787855801.769516:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464201856 00000100:00100000:3.0:1787855801.769533:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:3.0:1787855801.769537:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400696940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2360:x1874702464201984:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855801.769580:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400696940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2360:x1874702464201984:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 41us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855801.769591:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:3.0:1787855801.769603:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:3.0:1787855801.769609:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464201856:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855801.769632:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464201856:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 23us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855801.769650:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:3.0:1787855801.769670:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464202240 00000100:00100000:3.0:1787855801.769674:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464202240 00000100:00100000:3.0:1787855801.769853:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464202112 00000100:00100000:3.0:1787855801.769857:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464202112 00000100:00100000:3.0:1787855801.769884:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:3.0:1787855801.769891:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2360:x1874702464202240:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855801.769918:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2360:x1874702464202240:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 28us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855801.769924:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:3.0:1787855801.769936:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:3.0:1787855801.769942:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400697c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2360:x1874702464202112:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855801.769964:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400697c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2360:x1874702464202112:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 22us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855801.769970:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00080000:3.0:1787855801.770100:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787855801.770105:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787855801.770107:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855801.980449:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486254464:0@lo:400:kworker.0 00000100:00100000:1.0:1787855801.980521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855801.980607:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486254208:0@lo:400:kworker.0 00000100:00100000:1.0:1787855801.980641:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787855801.980648:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486254336:0@lo:400:kworker.0 00000100:00100000:0.0:1787855801.980661:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855801.980671:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855801.980686:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486254720:0@lo:400:kworker.0 00000100:00100000:0.0:1787855801.980712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855801.980741:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787855801.980747:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d8960780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486254592:0@lo:400:kworker.0 00000100:00100000:0.0:1787855801.980767:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855801.980823:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486254208 00000100:00100000:0.0:1787855801.980830:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486254208 00000100:00100000:0.0:1787855801.980873:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787855801.980878:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486254720 00000100:00100000:0.0:1787855801.980881:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486254208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855801.980882:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486254720 00000100:00100000:1.0:1787855801.980914:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787855801.980920:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1378f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486254720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855801.980928:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486254208:12345-0@lo:400:kworker.0 Request processed in 48us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855801.980935:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787855801.980949:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1378f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486254720:12345-0@lo:400:kworker.0 Request processed in 30us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855801.980954:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787855801.980963:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486254464 00000100:00100000:0.0:1787855801.980979:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486254464 00000100:00100000:0.0:1787855801.981012:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486254336 00000100:00100000:0.0:1787855801.981015:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486254336 00000100:00100000:0.0:1787855801.981026:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486254592 00000100:00100000:0.0:1787855801.981028:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486254592 00000100:00100000:0.0:1787855801.981040:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787855801.981045:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486254464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855801.981081:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486254464:12345-0@lo:400:kworker.0 Request processed in 35us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855801.981087:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787855801.981098:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787855801.981106:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c92821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486254336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855801.981133:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c92821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486254336:12345-0@lo:400:kworker.0 Request processed in 29us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855801.981138:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787855801.981147:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787855801.981152:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486254592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855801.981177:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486254592:12345-0@lo:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855801.981182:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787855801.981219:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d8960780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486254592:0@lo:400:kworker.0 00000100:00100000:0.0:1787855801.981228:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486254208:0@lo:400:kworker.0 00010000:00080000:0.0:1787855801.981238:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73c9282580 x1874702486254720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855801.981247:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486254720:0@lo:400:kworker.0 00000100:00100000:0.0:1787855801.981288:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486254336:0@lo:400:kworker.0 00000100:00100000:0.0:1787855801.981298:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486254464:0@lo:400:kworker.0 00000100:00080000:3.0:1787855801.981590:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787855801.981596:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787855802.108015:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855802.492027:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787855802.492051:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486254848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787855802.492124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855802.492202:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486254848 00000100:00100000:1.0:1787855802.492210:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486254848 00000100:00100000:1.0:1787855802.492258:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787855802.492266:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9283840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486254848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787855802.492309:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787855802.492363:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9283840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486254848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855802.492386:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787855802.492411:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73fab81a40 x1874702486254848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855802.492430:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab81a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486254848:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787855803.132419:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855804.156974:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855805.183185:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855806.204076:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855806.592015:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787855806.592038:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486254976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855806.592104:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855806.592179:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486254976 00000100:00100000:3.0:1787855806.592187:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486254976 00000100:00100000:3.0:1787855806.592242:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787855806.592251:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400697840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486254976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787855806.592289:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855806.592335:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400697840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486254976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855806.592343:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1787855806.592364:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787855806.592392:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a74006970c0 x1874702486254976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855806.592410:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486254976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787855806.890210:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855806.890300:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855806.890335:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855806.890374:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464202368 00000100:00100000:1.0:1787855806.890383:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464202368 00000100:00100000:1.0:1787855806.890456:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 225 00000100:00100000:1.0:1787855806.890479:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2359:x1874702464202368:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855806.890554:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2359:x1874702464202368:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 89us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855806.890562:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 225 00000100:00100000:0.0:1787855806.891344:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855806.891382:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855806.891649:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464202752 00000100:00100000:2.0:1787855806.891656:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464202752 00000100:00100000:2.0:1787855806.891703:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464202880 00000100:00100000:2.0:1787855806.891706:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464202880 00000100:00100000:2.0:1787855806.891725:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:2.0:1787855806.891733:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa096940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2356:x1874702464202752:12345-192.168.201.38@tcp:9:kworker.0 00000020:00000080:2.0:1787855806.891765:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d6a0 00000100:00080000:2.0:1787855806.891797:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9a73f743e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787855806.891837:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787855806.892169:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa096940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+2:2356:x1874702464202752:12345-192.168.201.38@tcp:9:kworker.0 Request processed in 436us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855806.892177:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:2.0:1787855806.892192:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:2.0:1787855806.892209:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2356:x1874702464202880:12345-192.168.201.38@tcp:9:kworker.0 00000020:00000080:2.0:1787855806.892224:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d6a7 00000100:00080000:2.0:1787855806.892231:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9a73f743f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787855806.892249:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787855806.892711:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+2:2356:x1874702464202880:12345-192.168.201.38@tcp:9:kworker.0 Request processed in 502us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855806.892719:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:3.0:1787855806.897531:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464202496 00000100:00100000:3.0:1787855806.897548:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464202496 00000100:00100000:3.0:1787855806.897674:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464202624 00000100:00100000:3.0:1787855806.897678:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464202624 00000100:00100000:1.0:1787855806.898164:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:1.0:1787855806.898177:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464202496:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855806.898250:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464202496:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 78us (8050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855806.898257:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:1.0:1787855806.898276:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:1.0:1787855806.898282:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2359:x1874702464202624:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855806.898305:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2359:x1874702464202624:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 24us (7970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855806.898311:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00080000:3.0:1787855806.899061:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787855806.899067:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787855806.899070:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787855806.899082:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855806.899523:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855807.104755:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486255360:0@lo:400:kworker.0 00000100:00100000:0.0:1787855807.104864:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855807.104925:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787855807.104931:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d8960780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486255488:0@lo:400:kworker.0 00000100:00100000:0.0:1787855807.104956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855807.104988:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486255360 00000100:00100000:0.0:1787855807.104995:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486255360 00000100:00100000:0.0:1787855807.105041:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486255488 00000100:00100000:0.0:1787855807.105044:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486255488 00000100:00100000:0.0:1787855807.105063:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787855807.105071:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f76483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486255360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855807.105123:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f76483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486255360:12345-0@lo:400:kworker.0 Request processed in 53us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855807.105130:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787855807.105146:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787855807.105151:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486255488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855807.105177:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486255488:12345-0@lo:400:kworker.0 Request processed in 26us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855807.105193:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1787855807.105213:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855807.105248:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d8960780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486255488:0@lo:400:kworker.0 00000100:00100000:0.0:1787855807.105258:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486255360:0@lo:400:kworker.0 00000100:00100000:2.0:1787855807.105639:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486255104:0@lo:400:kworker.0 00000100:00100000:2.0:1787855807.105676:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855807.105712:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486255616:0@lo:400:kworker.0 00000100:00100000:2.0:1787855807.105736:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855807.105756:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787855807.105763:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa095a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486255232:0@lo:400:kworker.0 00000100:00100000:2.0:1787855807.105814:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855807.105947:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486255232 00000100:00100000:1.0:1787855807.105952:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486255232 00000100:00100000:1.0:1787855807.105980:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787855807.105987:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486255232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855807.106961:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486255616 00000100:00100000:2.0:1787855807.106968:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486255616 00000100:00100000:2.0:1787855807.107014:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787855807.107024:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486255616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855807.111710:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486255104 00000100:00100000:0.0:1787855807.111726:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486255104 00000100:00100000:0.0:1787855807.111842:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787855807.111852:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3306:x1874702486255104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855807.118814:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486255232:12345-0@lo:400:kworker.0 Request processed in 12816us (12988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855807.118850:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787855807.118933:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa095a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486255232:0@lo:400:kworker.0 00000100:00080000:1.0:1787855807.119008:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787855807.123942:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486255616:12345-0@lo:400:kworker.0 Request processed in 16910us (18192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855807.123959:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787855807.124551:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73f764a940 x1874702486255616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855807.124576:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486255616:0@lo:400:kworker.0 00000100:00100000:0.0:1787855807.128591:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3306:x1874702486255104:12345-0@lo:400:kworker.0 Request processed in 16731us (22904us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855807.128608:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787855807.128867:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486255104:0@lo:400:kworker.0 00010000:00010000:3.0:1787855807.229508:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855807.612565:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787855807.612591:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486255744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787855807.612681:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855807.613029:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486255744 00000100:00100000:3.0:1787855807.613038:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486255744 00000100:00100000:3.0:1787855807.613094:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787855807.613104:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486255744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787855807.613142:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855807.613197:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486255744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855807.613221:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787855807.613267:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73fab830c0 x1874702486255744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855807.613296:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486255744:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787855807.711123:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76a6c3f7-1d4d-422f-86c9-d52d89a6ee45 00000020:00000080:2.0:1787855807.711132:0:6703:0:(genops.c:885:class_export_put()) final put ffff9a73f743c800/76a6c3f7-1d4d-422f-86c9-d52d89a6ee45 00000020:00000080:2.0:1787855807.711168:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73f743c800/76a6c3f7-1d4d-422f-86c9-d52d89a6ee45 for lustre-OST0000 00000020:00000080:2.0:1787855807.711203:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a73f743e000 for lustre-OST0000 00010000:00010000:3.0:1787855808.252942:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855809.282083:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787855810.227289:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 76a6c3f7-1d4d-422f-86c9-d52d89a6ee45 00000020:00000080:0.0:1787855810.227298:0:7628:0:(genops.c:885:class_export_put()) final put ffff9a73f743c000/76a6c3f7-1d4d-422f-86c9-d52d89a6ee45 00000020:00000080:1.0:1787855810.227376:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73f743c000/76a6c3f7-1d4d-422f-86c9-d52d89a6ee45 for lustre-OST0001 00000020:00000080:1.0:1787855810.227439:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a73f743f800 for lustre-OST0001 00010000:00010000:3.0:1787855810.300366:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855811.325120:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787855811.392654:0:11003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1787855811.711156:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400696d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486255872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787855811.711231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855811.711630:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486255872 00000100:00100000:3.0:1787855811.711639:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486255872 00000100:00100000:3.0:1787855811.711702:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787855811.711712:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7649a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486255872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787855811.711749:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855811.711817:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7649a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486255872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855811.711822:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787855811.711925:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787855811.712086:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a7400696d00 x1874702486255872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855811.712102:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400696d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486255872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787855812.017118:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855812.017169:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855812.017206:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855812.017328:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464203008 00000100:00100000:2.0:1787855812.017338:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464203008 00000100:00100000:2.0:1787855812.017409:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 227 00000100:00100000:2.0:1787855812.017424:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c54dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2359:x1874702464203008:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855812.017525:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c54dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2359:x1874702464203008:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 103us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855812.017533:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 227 00000100:00100000:0.0:1787855812.017893:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464203136 00000100:00100000:0.0:1787855812.017903:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464203136 00000100:00100000:0.0:1787855812.017962:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464203264 00000100:00100000:0.0:1787855812.017966:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464203264 00000100:00100000:0.0:1787855812.017992:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:0.0:1787855812.018004:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9280780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2359:x1874702464203136:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855812.018063:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9280780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2359:x1874702464203136:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 60us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855812.018071:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:0.0:1787855812.018084:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:0.0:1787855812.018091:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9281e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2359:x1874702464203264:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855812.018122:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9281e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2359:x1874702464203264:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 32us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855812.018129:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00080000:2.0:1787855812.019972:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855812.220272:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486256256:0@lo:400:kworker.0 00000100:00100000:1.0:1787855812.220343:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855812.220430:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787855812.220436:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486256128:0@lo:400:kworker.0 00000100:00100000:1.0:1787855812.220457:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855812.220473:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3357c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486256640:0@lo:400:kworker.0 00000100:00100000:1.0:1787855812.220491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855812.220522:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486256640 00000100:00100000:1.0:1787855812.220529:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486256640 00000100:00100000:1.0:1787855812.220584:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787855812.220592:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3356580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486256640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855812.220657:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3356580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486256640:12345-0@lo:400:kworker.0 Request processed in 66us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855812.220665:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787855812.220692:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486256256 00000100:00100000:1.0:1787855812.220696:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486256256 00000100:00100000:1.0:1787855812.220722:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486256128 00000100:00100000:1.0:1787855812.220725:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486256128 00000100:00100000:1.0:1787855812.220742:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787855812.220749:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486256256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855812.220810:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486256256:12345-0@lo:400:kworker.0 Request processed in 61us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855812.220817:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787855812.220828:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787855812.220834:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3357840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486256128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855812.220861:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3357840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486256128:12345-0@lo:400:kworker.0 Request processed in 28us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855812.220866:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1787855812.220886:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787855812.220890:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787855812.220915:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9282580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486256128:0@lo:400:kworker.0 00010000:00080000:1.0:1787855812.220936:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a72c3357c00 x1874702486256640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855812.220946:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3357c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486256640:0@lo:400:kworker.0 00000100:00100000:1.0:1787855812.220956:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486256256:0@lo:400:kworker.0 00000100:00100000:2.0:1787855812.221046:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486256000:0@lo:400:kworker.0 00000100:00100000:2.0:1787855812.221081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855812.221114:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486256512:0@lo:400:kworker.0 00000100:00100000:2.0:1787855812.221136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855812.221152:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787855812.221158:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486256384:0@lo:400:kworker.0 00000100:00100000:2.0:1787855812.221178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855812.221339:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486256512 00000100:00100000:0.0:1787855812.221344:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486256512 00000100:00100000:0.0:1787855812.221390:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787855812.221398:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486256512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855812.221434:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486256512:12345-0@lo:400:kworker.0 Request processed in 37us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855812.221440:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1787855812.221497:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855812.221518:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3356d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486256512:0@lo:400:kworker.0 00000100:00100000:1.0:1787855812.221589:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486256000 00000100:00100000:1.0:1787855812.221601:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486256000 00000100:00100000:1.0:1787855812.221631:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787855812.221638:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486256000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855812.221681:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486256000:12345-0@lo:400:kworker.0 Request processed in 44us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855812.221687:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787855812.221714:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486256384 00000100:00100000:1.0:1787855812.221718:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486256384 00000100:00100000:1.0:1787855812.221739:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787855812.221745:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486256384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855812.221797:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486256384:12345-0@lo:400:kworker.0 Request processed in 30us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855812.221803:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787855812.221908:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a72c33552c0 x1874702486256384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855812.221919:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486256384:0@lo:400:kworker.0 00000100:00100000:0.0:1787855812.221928:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92803c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486256000:0@lo:400:kworker.0 00010000:00010000:3.0:1787855812.356546:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855812.732047:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787855812.732080:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486256768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787855812.732179:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855812.733128:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486256768 00000100:00100000:3.0:1787855812.733141:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486256768 00000100:00100000:3.0:1787855812.733216:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787855812.733227:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400695a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486256768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787855812.733280:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855812.733427:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400695a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486256768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 201us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855812.733450:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787855812.733573:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a74006961c0 x1874702486256768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855812.733600:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486256768:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787855813.372940:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855814.399991:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855815.420605:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787855815.627565:0:11153:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca08839b0 20000000:00000080:3.0:1787855815.627589:0:11153:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a72c2271000 uarg=0000000000000000 20000000:01000000:3.0:1787855815.627653:0:11153:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787855815.627661:0:11153:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787855815.627667:0:11153:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787855815.629371:0:11154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787855815.629583:0:11153:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787855815.640521:0:11153:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787855815.640568:0:11153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.640593:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73d1228e00/0x516929ca3366d653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a36 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.640603:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d661 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d65a expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.640610:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c166d600/0x516929ca3366d66f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d668 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.640617:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c0031200/0x516929ca3366d67d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d676 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.640649:0:11153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73d1228600/0x516929ca3366d692 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a6e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.640658:0:11153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6ae lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.640716:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73d1228600/0x516929ca3366d692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a6e expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.640734:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a73d1228600/0x516929ca3366d692 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a6e expref: 12 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855815.640752:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3357480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874702486256896:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855815.640930:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c0031200/0x516929ca3366d67d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d676 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.640939:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a73c0031200/0x516929ca3366d67d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d676 expref: 18 pid: 5826 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855815.640949:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3357c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874702486257024:0@lo:104: 00000100:00100000:1.0:1787855815.641005:0:11153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787855815.641050:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c166d600/0x516929ca3366d66f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d668 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.641059:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a73c166d600/0x516929ca3366d66f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d668 expref: 18 pid: 5826 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855815.641066:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3356d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874702486257152:0@lo:104: 00000100:00100000:1.0:1787855815.641096:0:11153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787855815.641118:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d65a expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.641126:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d661 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d65a expref: 18 pid: 5827 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855815.641134:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92830c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874702486257280:0@lo:104: 00000100:00100000:1.0:1787855815.641152:0:11153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787855815.641172:0:11153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73d1228e00/0x516929ca3366d653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a36 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.641179:0:11153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a73d1228e00/0x516929ca3366d653 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a36 expref: 12 pid: 5826 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855815.641187:0:11153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb674f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874702486257408:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855815.641208:0:11153:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73f7880300 going to sleep for 11 seconds 00000100:00100000:0.0:1787855815.642620:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486257024 00000100:00100000:0.0:1787855815.642637:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486257024 00000100:00100000:0.0:1787855815.642704:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486257152 00000100:00100000:0.0:1787855815.642708:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486257152 00000100:00100000:0.0:1787855815.642717:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486257280 00000100:00100000:0.0:1787855815.642720:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486257280 00000100:00100000:0.0:1787855815.642753:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787855815.642763:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c33552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+5:11153:x1874702486257024:12345-0@lo:104: 00010000:00010000:0.0:1787855815.642800:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73d1228a00/0x516929ca3366d676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d67d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.642929:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787855815.642936:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c33552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+5:11153:x1874702486257024:12345-0@lo:104: Request processed in 175us (1932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855815.642943:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787855815.642962:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787855815.642968:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c92803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+4:11153:x1874702486257152:12345-0@lo:104: 00010000:00010000:0.0:1787855815.642976:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73c166d000/0x516929ca3366d668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d66f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643008:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787855815.643013:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c92803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+4:11153:x1874702486257152:12345-0@lo:104: Request processed in 46us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855815.643018:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787855815.643028:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787855815.643034:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9282580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:11153:x1874702486257280:12345-0@lo:104: 00010000:00010000:0.0:1787855815.643041:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366d65a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d661 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643066:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787855815.643070:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9282580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:11153:x1874702486257280:12345-0@lo:104: Request processed in 37us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855815.643075:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787855815.643101:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787855815.643107:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73d1228a00/0x516929ca3366d676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d67d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643115:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228a00 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787855815.643120:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73d1228a00/0x516929ca3366d676 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d67d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643129:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73d1228a00/0x516929ca3366d676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d67d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855815.643137:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73d1228a00/0x516929ca3366d676 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d67d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855815.643143:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787855815.643187:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73d1228a00/0x516929ca3366d676 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d67d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643194:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787855815.643218:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73d1228a00/0x516929ca3366d676 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d67d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643225:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73d1228a00/0x516929ca3366d676 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d67d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643240:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787855815.643366:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c166d000/0x516929ca3366d668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d66f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643374:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166d000 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787855815.643377:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c166d000/0x516929ca3366d668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d66f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643391:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c166d000/0x516929ca3366d668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d66f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855815.643397:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c166d000/0x516929ca3366d668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d66f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855815.643403:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787855815.643419:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c166d000/0x516929ca3366d668 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d66f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643425:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787855815.643431:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c166d000/0x516929ca3366d668 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d66f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643438:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c166d000/0x516929ca3366d668 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d66f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643448:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855815.643451:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366d65a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d661 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643457:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166c000 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787855815.643460:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366d65a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d661 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643467:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366d65a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d661 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855815.643474:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366d65a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d661 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855815.643485:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787855815.643500:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366d65a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d661 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643507:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787855815.643525:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366d65a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d661 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643532:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366d65a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d661 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.643547:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855815.643549:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855815.643550:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855815.643558:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855815.643582:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486257536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787855815.643632:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855815.643651:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3357c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874702486257024:0@lo:104: 00000100:00100000:1.0:1787855815.643661:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3356d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874702486257152:0@lo:104: 00000100:00100000:1.0:1787855815.643669:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92830c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874702486257280:0@lo:104: 00000100:00100000:0.0:1787855815.643673:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787855815.643679:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486257664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787855815.643701:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855815.643742:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486257792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787855815.643766:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855815.643817:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486257536 00000100:00100000:0.0:1787855815.643821:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486257536 00000100:00100000:1.0:1787855815.643931:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486257664 00000100:00100000:1.0:1787855815.643935:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486257664 00010000:00010000:0.0:1787855815.644309:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c0031200/0x516929ca3366d67d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d676 expref: 20 pid: 5826 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855815.644353:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486257792 00000100:00100000:0.0:1787855815.644366:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486257792 00000100:00100000:2.0:1787855815.644622:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787855815.644636:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c53db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+21:3304:x1874702486257536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787855815.644653:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855815.644660:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c0031200/0x516929ca3366d67d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d676 expref: 21 pid: 5826 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855815.644683:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c0031200/0x516929ca3366d67d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d676 expref: 21 pid: 5826 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855815.644700:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c0031200/0x516929ca3366d67d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d676 expref: 21 pid: 5826 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855815.644720:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855815.644767:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c53db450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+20:3304:x1874702486257536:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855815.644803:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787855815.653047:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c166d600/0x516929ca3366d66f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d668 expref: 20 pid: 5826 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855815.653130:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787855815.653156:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+20:3304:x1874702486257664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787855815.653177:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855815.653203:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c166d600/0x516929ca3366d66f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d668 expref: 20 pid: 5826 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.653216:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c166d600/0x516929ca3366d66f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d668 expref: 20 pid: 5826 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.653240:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c166d600/0x516929ca3366d66f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d668 expref: 20 pid: 5826 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.653265:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855815.653380:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486257664:12345-0@lo:103:ldlm_bl.0 Request processed in 239us (9677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855815.653389:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787855815.653496:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3357480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874702486256896:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855815.653510:0:11153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb674f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11153:1874702486257408:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855815.653568:0:11153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6ae lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855815.653964:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486257664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787855815.653976:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486257536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787855815.655623:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855815.656375:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464203392 00000100:00100000:1.0:1787855815.656390:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464203392 00010000:00010000:1.0:1787855815.656455:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73d1228600/0x516929ca3366d692 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a6e expref: 13 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855815.656511:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:1.0:1787855815.656522:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400696580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2357:x1874702464203392:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787855815.656540:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855815.656564:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73d1228600/0x516929ca3366d692 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a6e expref: 13 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.656581:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73d1228600/0x516929ca3366d692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a6e expref: 13 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.656603:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73d1228600/0x516929ca3366d692 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a6e expref: 13 pid: 5827 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.656623:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855815.656705:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400696580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:2357:x1874702464203392:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 184us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855815.656713:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:3.0:1787855815.660424:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855815.660691:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464203520 00000100:00100000:1.0:1787855815.660704:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464203520 00010000:00010000:1.0:1787855815.660757:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73d1228e00/0x516929ca3366d653 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a36 expref: 12 pid: 5826 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855815.660828:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:1.0:1787855815.660840:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:2357:x1874702464203520:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787855815.660858:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855815.660865:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73d1228e00/0x516929ca3366d653 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a36 expref: 12 pid: 5826 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.660878:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73d1228e00/0x516929ca3366d653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a36 expref: 12 pid: 5826 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.660899:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73d1228e00/0x516929ca3366d653 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a36 expref: 12 pid: 5826 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.660945:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855815.661012:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:2357:x1874702464203520:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 174us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855815.661020:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00010000:00010000:0.0:1787855815.661420:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d661 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d65a expref: 18 pid: 5827 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855815.661456:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787855815.661468:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:3306:x1874702486257792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787855815.661478:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855815.661482:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d661 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d65a expref: 18 pid: 5827 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.661492:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d661 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d65a expref: 18 pid: 5827 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.661503:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c166ce00/0x516929ca3366d661 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d65a expref: 18 pid: 5827 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.661517:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6ae lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.661527:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6ae lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.661545:0:7616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.661553:0:7616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6ae lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.661559:0:7616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6ae lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.661566:0:7616:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.661582:0:7616:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c0031400 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855815.661586:0:7616:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6ae lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.661595:0:7616:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6ae lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.661610:0:7616:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6ae lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855815.661622:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855815.662403:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa094000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:3306:x1874702486257792:12345-0@lo:103:ldlm_bl.0 Request processed in 934us (18630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855815.662414:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787855815.662478:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486257792:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787855815.662560:0:11153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.662571:0:11153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6ae lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855815.662578:0:11153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6ae lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855816.445164:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855816.830596:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787855816.830620:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400696d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486257920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787855816.830692:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855816.830805:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486257920 00000100:00100000:3.0:1787855816.830813:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486257920 00000100:00100000:3.0:1787855816.830877:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787855816.830887:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb676940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486257920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787855816.830924:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855816.830972:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb676940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486257920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855816.830979:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787855816.831018:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a7400696d00 x1874702486257920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855816.831041:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400696d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486257920:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787855816.831134:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1787855817.083889:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787855817.083897:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73e762a800 from 7 10000000:01000000:0.0:1787855817.083901:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787855817.083947:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5142200/0x516929ca3366d6b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855817.083958:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c5142200/0x516929ca3366d6b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855817.083970:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c5142200/0x516929ca3366d6b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855817.083996:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa095a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486258048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787855817.084072:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855817.084157:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c1d3e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787855817.088604:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486258048 00000100:00100000:3.0:1787855817.088619:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486258048 00000100:00100000:3.0:1787855817.088680:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787855817.088690:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486258048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855817.088708:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855817.088729:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73d1229000/0x516929ca3366d6bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d6b5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855817.088757:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1229000/0x516929ca3366d6bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d6b5 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855817.088767:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73d1229000/0x516929ca3366d6bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d6b5 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855817.088799:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229000, rc 0) 00000100:00100000:3.0:1787855817.088880:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486258048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (4808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855817.088888:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787855817.089058:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa095a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486258048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787855817.089077:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c5142200/0x516929ca3366d6b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d6bc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855817.089086:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c5142200/0x516929ca3366d6b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d6bc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855817.089159:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa095a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486258176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787855817.089193:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855817.089230:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c1d3e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787855817.089305:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486258176 00000100:00100000:3.0:1787855817.089310:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486258176 00000100:00100000:3.0:1787855817.089341:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787855817.089348:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486258176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855817.091736:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486258176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2378us (2532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855817.091751:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787855817.095342:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa095a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486258176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787855817.095405:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa095a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486258304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787855817.095478:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855817.096520:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c1d3e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855817.098935:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486258304 00000100:00100000:1.0:1787855817.098950:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486258304 00000100:00100000:1.0:1787855817.099007:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787855817.099017:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486258304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787855817.099710:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486258304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 693us (4230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855817.099719:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787855817.100020:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa095a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486258304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787855817.100909:0:11184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787855817.101307:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787855817.101331:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787855817.101343:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5142200/0x516929ca3366d6b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d6bc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855817.101362:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c5142200/0x516929ca3366d6b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d6bc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787855817.101372:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787855817.101375:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73d0d01000 from 7 10000000:01000000:1.0:1787855817.101378:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787855817.101411:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c0031000/0x516929ca3366d6c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855817.101419:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c0031000/0x516929ca3366d6c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855817.101429:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c0031000/0x516929ca3366d6c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855817.101454:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb675a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486258432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787855817.101511:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855817.101583:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73f7880900 going to sleep for 11 seconds 00000100:00100000:3.0:1787855817.101626:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486258432 00000100:00100000:3.0:1787855817.101632:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486258432 00000100:00100000:3.0:1787855817.101708:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787855817.101718:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486258432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855817.101731:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855817.101743:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73d1229c00/0x516929ca3366d6ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d6c3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855817.101767:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1229c00/0x516929ca3366d6ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d6c3 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855817.101810:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73d1229c00/0x516929ca3366d6ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d6c3 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855817.101819:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229c00, rc 0) 00000100:00100000:3.0:1787855817.101869:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486258432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855817.101876:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787855817.101986:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb675a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486258432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787855817.101999:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c0031000/0x516929ca3366d6c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d6ca expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855817.102007:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c0031000/0x516929ca3366d6c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d6ca expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855817.102052:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486258560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787855817.102077:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855817.102323:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e746ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787855817.102397:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486258560 00000100:00100000:1.0:1787855817.102403:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486258560 00000100:00100000:1.0:1787855817.102426:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787855817.102432:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486258560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787855817.102670:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486258560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855817.102677:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787855817.102748:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486258560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787855817.102809:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486258688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787855817.102847:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855817.102863:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e746ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787855817.102903:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486258688 00000100:00100000:1.0:1787855817.102907:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486258688 00000100:00100000:1.0:1787855817.102923:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787855817.102935:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486258688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787855817.103076:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486258688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855817.103082:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787855817.103151:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486258688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787855817.104392:0:11185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787855817.104549:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787855817.104566:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787855817.104576:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c0031000/0x516929ca3366d6c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d6ca expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855817.104586:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c0031000/0x516929ca3366d6c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d6ca expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855817.104596:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787855817.104599:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73f4b59000 from 7 10000000:01000000:2.0:1787855817.104602:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787855817.104630:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402046e00/0x516929ca3366d6d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855817.104638:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a7402046e00/0x516929ca3366d6d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855817.104648:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a7402046e00/0x516929ca3366d6d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855817.104668:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486258816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787855817.104717:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855817.104754:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c57e9300 going to sleep for 11 seconds 00000100:00100000:1.0:1787855817.104866:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486258816 00000100:00100000:1.0:1787855817.104871:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486258816 00000100:00100000:1.0:1787855817.104912:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787855817.104921:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486258816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787855817.104932:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855817.104943:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d6d1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855817.104964:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d6d1 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855817.104975:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d6d1 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855817.104984:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c0031400, rc 0) 00000100:00100000:1.0:1787855817.105078:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486258816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855817.105086:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787855817.105310:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486258816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787855817.105327:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a7402046e00/0x516929ca3366d6d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d6d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855817.105338:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a7402046e00/0x516929ca3366d6d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d6d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855817.105394:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486258944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787855817.105420:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855817.105475:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c57e9300 going to sleep for 11 seconds 00000100:00100000:0.0:1787855817.105507:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486258944 00000100:00100000:0.0:1787855817.105512:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486258944 00000100:00100000:0.0:1787855817.105573:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787855817.105582:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486258944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787855817.106409:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486258944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 826us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855817.106416:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787855817.106473:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486258944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787855817.106506:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486259072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787855817.106543:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855817.106602:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c57e9300 going to sleep for 11 seconds 00000100:00100000:1.0:1787855817.106632:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486259072 00000100:00100000:1.0:1787855817.106636:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486259072 00000100:00100000:1.0:1787855817.106700:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787855817.106708:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486259072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787855817.106879:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486259072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855817.106886:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787855817.106967:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab82580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486259072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787855817.107987:0:11186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787855817.108489:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787855817.108508:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787855817.108519:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402046e00/0x516929ca3366d6d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d6d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855817.108530:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a7402046e00/0x516929ca3366d6d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d6d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855817.124985:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855817.125022:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855817.125052:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855817.125353:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464203648 00000100:00100000:1.0:1787855817.125363:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464203648 00000100:00100000:1.0:1787855817.125424:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 238 00000100:00100000:1.0:1787855817.125440:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:2359:x1874702464203648:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855817.125523:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:2359:x1874702464203648:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 84us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855817.125531:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 238 00000100:00100000:0.0:1787855817.125983:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464203904 00000100:00100000:0.0:1787855817.125989:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464203904 00000100:00100000:2.0:1787855817.126101:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464203776 00000100:00100000:2.0:1787855817.126106:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464203776 00000100:00100000:2.0:1787855817.126156:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 89 00000100:00100000:2.0:1787855817.126168:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2359:x1874702464203776:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855817.126209:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2359:x1874702464203776:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 46us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855817.126216:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 89 00000100:00080000:0.0:1787855817.126359:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855817.126463:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00100000:1.0:1787855817.126471:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400696d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2359:x1874702464203904:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855817.126510:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400696d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2359:x1874702464203904:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 40us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855817.126518:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00080000:0.0:1787855817.126661:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855817.320348:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855817.320638:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464204032 00000100:00100000:3.0:1787855817.320655:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464204032 00000100:00100000:3.0:1787855817.320986:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 239 00000100:00100000:3.0:1787855817.321000:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:5598:x1874702464204032:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855817.321034:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855817.321060:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73d1228800/0x516929ca3366d6df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616a98 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855817.321114:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1228800/0x516929ca3366d6df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a98 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855817.321128:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73d1228800/0x516929ca3366d6df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a98 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855817.321139:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228800, rc 0) 00000100:00100000:3.0:1787855817.321258:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:5598:x1874702464204032:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 261us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855817.321266:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 239 00000100:00100000:3.0:1787855817.328903:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855817.328945:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464204160 00000100:00100000:3.0:1787855817.328955:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464204160 00000100:00100000:3.0:1787855817.329001:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 240 00000100:00100000:3.0:1787855817.329012:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:5598:x1874702464204160:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855817.329329:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:5598:x1874702464204160:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 317us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855817.329341:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 240 00000100:00100000:1.0:1787855817.340962:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486259200:0@lo:400:kworker.0 00000100:00100000:3.0:1787855817.341052:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400695680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486259328:0@lo:400:kworker.0 00000100:00100000:1.0:1787855817.341061:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855817.341138:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855817.341153:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400697c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486259712:0@lo:400:kworker.0 00000100:00100000:3.0:1787855817.341185:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1322940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486259840:0@lo:400:kworker.0 00000100:00100000:1.0:1787855817.341206:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855817.341251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855817.341301:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486259840 00000100:00100000:1.0:1787855817.341313:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486259840 00000100:00100000:3.0:1787855817.341321:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400695e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486259456:0@lo:400:kworker.0 00000100:00100000:3.0:1787855817.341356:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855817.341401:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787855817.341404:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787855817.341412:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486259584:0@lo:400:kworker.0 00000100:00100000:1.0:1787855817.341434:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486259840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855817.341451:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855817.341511:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486259840:12345-0@lo:400:kworker.0 Request processed in 81us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855817.341519:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787855817.341542:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486259584 00000100:00100000:1.0:1787855817.341546:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486259584 00000100:00100000:3.0:1787855817.341578:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486259200 00000100:00100000:1.0:1787855817.341585:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787855817.341589:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486259200 00000100:00100000:1.0:1787855817.341595:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1322d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486259584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855817.341658:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787855817.341665:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1322d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486259584:12345-0@lo:400:kworker.0 Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855817.341672:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486259200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855817.341688:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1787855817.341712:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787855817.341753:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486259200:12345-0@lo:400:kworker.0 Request processed in 84us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855817.341762:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787855817.341836:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486259328 00000100:00100000:3.0:1787855817.341840:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486259328 00000100:00100000:3.0:1787855817.341870:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486259712 00000100:00100000:3.0:1787855817.341873:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486259712 00000100:00100000:3.0:1787855817.341900:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486259456 00000100:00100000:3.0:1787855817.341904:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486259456 00000100:00100000:3.0:1787855817.341921:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787855817.341928:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486259328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855817.341963:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486259328:12345-0@lo:400:kworker.0 Request processed in 35us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855817.341970:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787855817.341983:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787855817.341990:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb677840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486259712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855817.342019:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb677840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486259712:12345-0@lo:400:kworker.0 Request processed in 31us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855817.342024:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787855817.342038:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787855817.342043:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1323c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486259456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855817.342085:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1323c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486259456:12345-0@lo:400:kworker.0 Request processed in 42us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855817.342091:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1787855817.342131:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787855817.342163:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a74006952c0 x1874702486259584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855817.342179:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486259584:0@lo:400:kworker.0 00000100:00100000:3.0:1787855817.342193:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400695e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486259456:0@lo:400:kworker.0 00000100:00100000:3.0:1787855817.342230:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400695680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486259328:0@lo:400:kworker.0 00010000:00080000:3.0:1787855817.342241:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d1322940 x1874702486259840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855817.342250:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1322940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486259840:0@lo:400:kworker.0 00000100:00100000:3.0:1787855817.342959:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855817.343281:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400697c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486259712:0@lo:400:kworker.0 00000100:00100000:1.0:1787855817.343317:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486259200:0@lo:400:kworker.0 00000100:00100000:0.0:1787855817.346516:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464204288 00000100:00100000:0.0:1787855817.346536:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464204288 00000100:00100000:0.0:1787855817.346622:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 242 00000100:00100000:0.0:1787855817.346635:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:5598:x1874702464204288:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787855817.347071:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:5598:x1874702464204288:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 436us (4115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855817.347080:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 242 00000100:00100000:0.0:1787855817.362699:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855817.363118:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464204416 00000100:00100000:3.0:1787855817.363131:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464204416 00000100:00100000:3.0:1787855817.363199:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 243 00000100:00100000:3.0:1787855817.363211:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:5598:x1874702464204416:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855817.363245:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855817.363269:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73d1229600/0x516929ca3366d6e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616a9f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855817.363314:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1229600/0x516929ca3366d6e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a9f expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855817.363328:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73d1229600/0x516929ca3366d6e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a9f expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855817.363353:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229600, rc 0) 00000100:00100000:3.0:1787855817.363447:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:5598:x1874702464204416:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 237us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855817.363455:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 243 00000100:00100000:3.0:1787855817.368244:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855817.368482:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464204544 00000100:00100000:1.0:1787855817.368498:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464204544 00000100:00100000:1.0:1787855817.368583:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 244 00000100:00100000:1.0:1787855817.368594:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:5598:x1874702464204544:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787855817.368970:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc127050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:5598:x1874702464204544:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 377us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855817.368980:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 244 00000100:00100000:3.0:1787855817.371091:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855817.371855:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464204672 00000100:00100000:1.0:1787855817.371875:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464204672 00000100:00100000:1.0:1787855817.371960:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 245 00000100:00100000:1.0:1787855817.371975:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:5598:x1874702464204672:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787855817.372302:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4973450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:5598:x1874702464204672:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 329us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855817.372313:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 245 00010000:00010000:0.0:1787855817.472695:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855817.855248:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787855817.855282:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb675e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486259968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787855817.855350:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855817.855413:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486259968 00000100:00100000:1.0:1787855817.855419:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486259968 00000100:00100000:1.0:1787855817.855463:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787855817.855472:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb675680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486259968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787855817.855505:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787855817.855550:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb675680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486259968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855817.855557:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787855817.855597:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73cb675e00 x1874702486259968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855817.855615:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb675e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486259968:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787855818.492833:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855819.515940:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787855819.940698:0:11351:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787855820.540481:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855821.568441:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855821.949148:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787855821.949170:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb674f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486260096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787855821.949250:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855821.949322:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486260096 00000100:00100000:1.0:1787855821.949330:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486260096 00000100:00100000:1.0:1787855821.949387:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787855821.949410:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb675e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486260096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787855821.949446:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787855821.949509:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb675e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486260096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855821.949517:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1787855821.949538:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787855821.949567:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73cb674f00 x1874702486260096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855821.949585:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb674f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486260096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787855822.263389:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855822.263437:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855822.263472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855822.263502:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464205056 00000100:00100000:1.0:1787855822.263511:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464205056 00000100:00100000:1.0:1787855822.263562:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464204928 00000100:00100000:1.0:1787855822.263565:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464204928 00000100:00100000:1.0:1787855822.263584:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00100000:1.0:1787855822.263593:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb674f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2360:x1874702464205056:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855822.263655:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb674f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2360:x1874702464205056:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 63us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855822.263662:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00100000:1.0:1787855822.263678:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 95 00000100:00100000:1.0:1787855822.263684:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464204928:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855822.263705:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464204928:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 21us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855822.263711:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 95 00000100:00080000:1.0:1787855822.263726:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855822.264054:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464204800 00000100:00100000:2.0:1787855822.264059:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464204800 00000100:00100000:2.0:1787855822.264101:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 246 00000100:00100000:2.0:1787855822.264109:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2360:x1874702464204800:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855822.264147:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4970050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2360:x1874702464204800:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 39us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855822.264154:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 246 00000100:00100000:3.0:1787855822.466548:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa095a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486260352:0@lo:400:kworker.0 00000100:00100000:0.0:1787855822.466611:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d8960780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486260480:0@lo:400:kworker.0 00000100:00100000:3.0:1787855822.466617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855822.466692:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486260224:0@lo:400:kworker.0 00000100:00100000:1.0:1787855822.466716:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f763de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486260608:0@lo:400:kworker.0 00000100:00100000:0.0:1787855822.466767:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855822.466853:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486260352 00000100:00100000:0.0:1787855822.466861:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486260352 00000100:00100000:0.0:1787855822.466902:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486260480 00000100:00100000:0.0:1787855822.466917:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486260480 00000100:00100000:0.0:1787855822.466952:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787855822.466961:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1323840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486260352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855822.467007:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1323840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486260352:12345-0@lo:400:kworker.0 Request processed in 47us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855822.467014:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787855822.467039:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787855822.467045:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486260480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855822.467077:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486260480:12345-0@lo:400:kworker.0 Request processed in 33us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855822.467083:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1787855822.467118:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855822.467256:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d8960780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486260480:0@lo:400:kworker.0 00000100:00100000:3.0:1787855822.473351:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa095a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486260352:0@lo:400:kworker.0 00000100:00100000:3.0:1787855822.473392:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f763e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486260864:0@lo:400:kworker.0 00000100:00100000:3.0:1787855822.473463:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855822.473530:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486260864 00000100:00100000:3.0:1787855822.473537:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486260864 00000100:00100000:3.0:1787855822.473593:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787855822.473604:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486260864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855822.473673:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486260864:12345-0@lo:400:kworker.0 Request processed in 71us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855822.473681:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787855822.473716:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73f763e940 x1874702486260864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855822.473736:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f763e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486260864:0@lo:400:kworker.0 00000100:00080000:3.0:1787855822.473756:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787855822.477389:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855822.477458:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f763cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486260736:0@lo:400:kworker.0 00000100:00100000:2.0:1787855822.477499:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855822.478091:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486260224 00000100:00100000:0.0:1787855822.478102:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486260224 00000100:00100000:0.0:1787855822.478160:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787855822.478169:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486260224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855822.478236:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486260224:12345-0@lo:400:kworker.0 Request processed in 69us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855822.478243:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787855822.479355:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486260736 00000100:00100000:3.0:1787855822.479378:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486260736 00000100:00100000:3.0:1787855822.479449:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787855822.479458:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486260736:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787855822.479501:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855822.479526:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486260736:12345-0@lo:400:kworker.0 Request processed in 69us (2025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855822.479534:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787855822.479898:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855822.479963:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486260224:0@lo:400:kworker.0 00000100:00100000:2.0:1787855822.479980:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f763cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486260736:0@lo:400:kworker.0 00000100:00100000:0.0:1787855822.483372:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486260608 00000100:00100000:0.0:1787855822.483386:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486260608 00000100:00100000:0.0:1787855822.483533:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787855822.483545:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486260608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855822.483656:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486260608:12345-0@lo:400:kworker.0 Request processed in 104us (3748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855822.483663:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1787855822.483750:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73f763de00 x1874702486260608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855822.483767:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f763de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486260608:0@lo:400:kworker.0 00010000:00010000:0.0:1787855822.588446:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855822.973029:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1320f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486260992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787855822.973119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855822.973630:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486260992 00000100:00100000:3.0:1787855822.973648:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486260992 00000100:00100000:3.0:1787855822.973701:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787855822.973711:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486260992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787855822.973747:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855822.973815:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486260992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855822.973823:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787855822.973951:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d1320f00 x1874702486260992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855822.973984:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1320f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486260992:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787855823.617682:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787855823.879225:0:11451:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:37:02 (1787855822) === 00000100:00100000:3.0:1787855824.148593:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855824.148705:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464205184 00000100:00100000:0.0:1787855824.148720:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464205184 00000100:00100000:3.0:1787855824.148741:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855824.148895:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:3.0:1787855824.148915:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2358:x1874702464205184:12345-192.168.201.38@tcp:41:mkdir.0 00000100:00080000:1.0:1787855824.148971:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1787855824.148979:0:9629:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787855824.149078:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464205312 00000100:00100000:2.0:1787855824.149085:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464205312 00000100:00100000:3.0:1787855824.149109:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2358:x1874702464205184:12345-192.168.201.38@tcp:41:mkdir.0 Request processed in 200us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855824.149119:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:2.0:1787855824.149151:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:2.0:1787855824.149177:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1322580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:9678:x1874702464205312:12345-192.168.201.38@tcp:700:mkdir.0 00000100:00100000:2.0:1787855824.149258:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1322580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:9678:x1874702464205312:12345-192.168.201.38@tcp:700:mkdir.0 Request processed in 98us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855824.149265:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1787855824.151902:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855824.152009:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464205568 00000100:00100000:3.0:1787855824.152021:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464205568 00000100:00100000:3.0:1787855824.152099:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:3.0:1787855824.152112:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb677c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:9678:x1874702464205568:12345-192.168.201.38@tcp:36:mkdir.0 00010000:00010000:3.0:1787855824.152220:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855824.154296:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402172c00/0x516929ca3366d5ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a21 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.154330:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:3.0:1787855824.154348:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787855824.155339:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d6ed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.155360:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d6ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.155371:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d6ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.155422:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d6f4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.155430:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d6f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.155436:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d6f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855824.158611:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787855824.158632:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d6ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.158643:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d6ed lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.158650:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d6ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.158759:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855824.158764:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d6ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.158772:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d6ed lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.158814:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40acb00) 00010000:00010000:3.0:1787855824.158818:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855824.158822:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d6ed lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.158829:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d6ed lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787855824.158849:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6849d8f reply state 00000000dfc24c6c transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d6f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855824.158858:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787855824.159349:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb677c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:9678:x1874702464205568:12345-192.168.201.38@tcp:36:mkdir.0 Request processed in 7235us (7458us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787855824.159359:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00010000:00010000:0.0:1787855824.163271:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d6f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.163289:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d6f4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.163298:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d6f4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.163305:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855824.163309:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d6f4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.163317:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d6f4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.163337:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a73d40ac700) 00010000:00010000:0.0:1787855824.163340:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855824.163345:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d6f4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.163350:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d6f4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855824.173636:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855824.174535:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464205696 00000100:00100000:0.0:1787855824.174562:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464205696 00000100:00100000:0.0:1787855824.174631:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:0.0:1787855824.174643:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb676d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:9679:x1874702464205696:12345-192.168.201.38@tcp:101:chmod.0 00010000:00010000:0.0:1787855824.174825:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855824.174851:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143600/0x516929ca3366d6fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616aa6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.175228:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366d702 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.175243:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366d702 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.175255:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366d702 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855824.175320:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787855824.175325:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787855824.175370:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366d702 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.175400:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143600/0x516929ca3366d6fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616aa6 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.175421:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366d702 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616aa6 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.175432:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73f49fb100) 00010000:00010000:0.0:1787855824.175435:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787855824.175438:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143000, rc 0) 00000100:00100000:0.0:1787855824.175762:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb676d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:9679:x1874702464205696:12345-192.168.201.38@tcp:101:chmod.0 Request processed in 1119us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855824.175771:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:1.0:1787855824.186160:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855824.189764:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464205952 00000100:00100000:0.0:1787855824.189835:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464205952 00000100:00100000:3.0:1787855824.191188:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:3.0:1787855824.191204:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb675a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:9679:x1874702464205952:12345-192.168.201.38@tcp:36:chmod.0 00010000:00010000:3.0:1787855824.191412:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855824.191443:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366d702 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616aa6 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.191484:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73f49fb100) 00010000:00010000:3.0:1787855824.191495:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787855824.191521:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d709 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.191533:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d709 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.191543:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d709 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787855824.192237:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a77c964 reply state 00000000805d3f58 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d709 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855824.192249:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787855824.192333:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787855824.192432:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb675a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:9679:x1874702464205952:12345-192.168.201.38@tcp:36:chmod.0 Request processed in 1230us (6280us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787855824.192440:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00010000:00010000:1.0:1787855824.197828:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d709 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.197847:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d709 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.197853:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d709 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.197857:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855824.197861:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d709 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.197866:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d709 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.197974:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40acb00) 00010000:00010000:1.0:1787855824.197976:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787855824.197980:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d709 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.197985:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d709 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855824.250212:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855824.250389:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464206080 00000100:00100000:3.0:1787855824.250612:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464206080 00000100:00100000:3.0:1787855824.250930:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:3.0:1787855824.250944:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7648b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:9680:x1874702464206080:12345-192.168.201.38@tcp:101:chown.0 00010000:00010000:3.0:1787855824.250978:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855824.251013:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d710 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616aad expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.251105:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d717 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.251138:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d717 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.251152:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d717 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855824.251239:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787855824.251243:0:9629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787855824.251303:0:9629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d717 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.251346:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229400/0x516929ca3366d710 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616aad expref: 9 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.251369:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d717 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616aad expref: 8 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855824.251378:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:3.0:1787855824.251381:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787855824.251385:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229200, rc 0) 00000100:00100000:3.0:1787855824.253005:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7648b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:9680:x1874702464206080:12345-192.168.201.38@tcp:101:chown.0 Request processed in 2051us (2791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855824.253021:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:3.0:1787855824.258124:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855824.258251:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464206208 00000100:00100000:1.0:1787855824.258273:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464206208 00000100:00100000:1.0:1787855824.258353:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:1.0:1787855824.258364:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1321a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:9680:x1874702464206208:12345-192.168.201.38@tcp:101:chown.0 00010000:00010000:1.0:1787855824.258390:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855824.258419:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366d71e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616ab4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258515:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d725 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258532:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258544:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258560:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d72c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258567:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d72c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258573:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d72c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258712:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d733 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258748:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258755:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855824.258840:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787855824.258845:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787855824.258877:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d733 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258891:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d725 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258898:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d725 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258906:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d725 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258913:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffe00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855824.258918:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d725 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258927:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d725 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258941:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:1.0:1787855824.258945:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855824.258950:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d725 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258969:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d725 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258985:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d72c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258992:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d72c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.258998:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d72c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.259004:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fec00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855824.259007:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d72c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.259014:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d72c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.259024:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a73c8d1d200) 00010000:00010000:1.0:1787855824.259026:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855824.259029:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d72c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.259036:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d72c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.259074:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366d71e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ab4 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.259090:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d733 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ab4 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.259105:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a73c8d1d700) 00010000:00010000:1.0:1787855824.259107:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787855824.259110:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ffa00, rc 0) 00000100:00100000:1.0:1787855824.259211:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1321a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:9680:x1874702464206208:12345-192.168.201.38@tcp:101:chown.0 Request processed in 847us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855824.259221:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:2.0:1787855824.271039:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855824.271171:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464206464 00000100:00100000:0.0:1787855824.271184:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464206464 00000100:00100000:0.0:1787855824.271271:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:0.0:1787855824.271284:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:9680:x1874702464206464:12345-192.168.201.38@tcp:36:chown.0 00010000:00010000:0.0:1787855824.271371:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855824.271413:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d733 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ab4 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.271438:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a73c8d1d700) 00010000:00010000:0.0:1787855824.271463:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787855824.271497:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142600/0x516929ca3366d73a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.271513:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142600/0x516929ca3366d73a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.271524:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142600/0x516929ca3366d73a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787855824.329243:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4abc99f reply state 0000000019e4ce36 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142600/0x516929ca3366d73a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855824.329271:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787855824.329499:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787855824.329655:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+10:9680:x1874702464206464:12345-192.168.201.38@tcp:36:chown.0 Request processed in 58367us (58625us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787855824.329675:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000001:00080000:3.0:1787855824.329955:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1787855824.330036:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142600/0x516929ca3366d73a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.330046:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142600/0x516929ca3366d73a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.330053:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142600/0x516929ca3366d73a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.330060:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855824.330065:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142600/0x516929ca3366d73a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.330074:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142600/0x516929ca3366d73a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.330093:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a73f49fba00) 00010000:00010000:0.0:1787855824.330096:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787855824.330112:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142600/0x516929ca3366d73a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.330120:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142600/0x516929ca3366d73a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855824.373228:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855824.373850:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464206592 00000100:00100000:1.0:1787855824.373865:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464206592 00000100:00100000:1.0:1787855824.373947:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:1.0:1787855824.373959:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:9681:x1874702464206592:12345-192.168.201.38@tcp:101:touch.500 00010000:00010000:1.0:1787855824.373991:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855824.374019:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366d741 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616abb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787855824.379969:0:5833:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5885us 00010000:00010000:2.0:1787855824.399924:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047a00/0x516929ca3366d748 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.399955:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047a00/0x516929ca3366d748 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.399972:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047a00/0x516929ca3366d748 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400000:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d74f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400008:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d74f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400015:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d74f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400543:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d756 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400554:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400562:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855824.400647:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787855824.400651:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787855824.400743:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400760:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047a00/0x516929ca3366d748 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400767:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047a00/0x516929ca3366d748 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400802:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047a00/0x516929ca3366d748 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400818:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402047a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855824.400823:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047a00/0x516929ca3366d748 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400832:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047a00/0x516929ca3366d748 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400847:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:2.0:1787855824.400850:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855824.400855:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047a00/0x516929ca3366d748 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400862:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047a00/0x516929ca3366d748 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400874:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d74f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400880:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d74f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400887:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d74f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400892:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402046000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855824.400894:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d74f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400900:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d74f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400914:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a73c7093f00) 00010000:00010000:2.0:1787855824.400917:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855824.400919:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d74f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400925:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d74f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400970:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366d741 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616abb expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400986:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616abb expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.400993:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a73c7093400) 00010000:00010000:2.0:1787855824.400995:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787855824.400997:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402047400, rc 0) 00000100:00100000:2.0:1787855824.401089:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:9681:x1874702464206592:12345-192.168.201.38@tcp:101:touch.500 Request processed in 27131us (27885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855824.401100:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:0.0:1787855824.409665:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855824.410415:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464206848 00000100:00100000:2.0:1787855824.410431:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464206848 00000100:00100000:2.0:1787855824.410566:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:2.0:1787855824.410581:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:9681:x1874702464206848:12345-192.168.201.38@tcp:101:touch.500 00010000:00010000:2.0:1787855824.410610:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855824.410638:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046c00/0x516929ca3366d75d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616ac2 expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.411144:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d764 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.411172:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d764 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.411185:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d764 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.415131:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047200/0x516929ca3366d76b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.415155:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047200/0x516929ca3366d76b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.415178:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047200/0x516929ca3366d76b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787855824.419131:0:9629:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787855824.419479:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d772 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.419496:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.419507:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.419545:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d764 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.419565:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d764 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.419571:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d764 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.419578:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402047800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855824.419583:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d764 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.419591:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d764 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.419604:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a73c7093400) 00010000:00010000:2.0:1787855824.419608:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855824.419612:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d764 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.419618:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d764 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787855824.419632:0:9629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a55865b3 reply state 00000000bbdb21de transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047200/0x516929ca3366d76b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855824.419641:0:9629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787855824.419680:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046c00/0x516929ca3366d75d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ac2 expref: 10 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.419694:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ac2 expref: 9 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.419712:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:2.0:1787855824.419715:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787855824.419717:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402046000, rc 0) 00000100:00100000:2.0:1787855824.421064:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+10:9681:x1874702464206848:12345-192.168.201.38@tcp:101:touch.500 Request processed in 10473us (11403us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787855824.421076:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00010000:00010000:1.0:1787855824.422854:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047200/0x516929ca3366d76b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.422876:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047200/0x516929ca3366d76b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.422885:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047200/0x516929ca3366d76b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.422892:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402047200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855824.422898:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047200/0x516929ca3366d76b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.422929:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047200/0x516929ca3366d76b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.422952:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb7cbccd0 (ffff9a73c7093b00) 00010000:00010000:1.0:1787855824.422955:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855824.422961:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047200/0x516929ca3366d76b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.422967:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047200/0x516929ca3366d76b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855824.427884:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855824.428494:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464207104 00000100:00100000:1.0:1787855824.428509:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464207104 00000100:00100000:1.0:1787855824.428590:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:1.0:1787855824.428604:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:9681:x1874702464207104:12345-192.168.201.38@tcp:36:touch.500 00010000:00010000:1.0:1787855824.428688:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855824.428727:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ac2 expref: 9 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.428753:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:1.0:1787855824.428770:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787855824.428865:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d780 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.428882:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.428894:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787855824.429088:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006bef242c reply state 0000000050bef825 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855824.429440:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787855824.429588:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+10:9681:x1874702464207104:12345-192.168.201.38@tcp:36:touch.500 Request processed in 985us (1721us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787855824.429598:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00010000:00010000:1.0:1787855824.432086:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d780 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.432108:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d780 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.432117:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d780 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.432124:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffe00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855824.432129:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d780 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.432137:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d780 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.432169:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a73c8d1d900) 00010000:00010000:1.0:1787855824.432174:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855824.432180:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d780 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.432186:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d780 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855824.434528:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855824.434943:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464207232 00000100:00100000:2.0:1787855824.434959:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464207232 00000100:00100000:2.0:1787855824.435045:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:2.0:1787855824.435065:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:9681:x1874702464207232:12345-192.168.201.38@tcp:101:touch.500 00010000:00010000:2.0:1787855824.435089:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855824.435113:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046c00/0x516929ca3366d787 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616ac9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.435186:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046c00/0x516929ca3366d787 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ac9 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.435201:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046c00/0x516929ca3366d787 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ac9 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.435220:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a73c7093600) 00010000:00010000:2.0:1787855824.435223:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787855824.435227:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402046c00, rc 0) 00000100:00100000:2.0:1787855824.435322:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+10:9681:x1874702464207232:12345-192.168.201.38@tcp:101:touch.500 Request processed in 267us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855824.435345:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:3.0:1787855824.443730:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855824.443970:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464207360 00000100:00100000:1.0:1787855824.443984:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464207360 00000100:00100000:1.0:1787855824.444062:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:1.0:1787855824.444071:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1874702464207360:12345-192.168.201.38@tcp:8:touch.500 00010000:00080000:1.0:1787855824.444105:0:8077:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:1.0:1787855824.444139:0:8077:0:(genops.c:1385:class_connect()) connect: client 6933b672-fa85-4aae-9dc8-092c3f355bbf, cookie 0x516929ca3366d78e 00002000:00100000:1.0:1787855824.444150:0:8077:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6933b672-fa85-4aae-9dc8-092c3f355bbf/ffff9a72c1321800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787855824.444185:0:8077:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787855824.444422:0:8077:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787855824.444454:0:8077:0:(import.c:65:import_set_state_nolock()) ffff9a72c1327000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787855824.444536:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2356:x1874702464207360:12345-192.168.201.38@tcp:8:touch.500 Request processed in 463us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855824.444545:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:3.0:1787855824.447711:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855824.447955:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464207488 00000100:00100000:1.0:1787855824.447970:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464207488 00000100:00080000:0.0:1787855824.448076:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787855824.448232:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:1.0:1787855824.448245:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:0:x1874702464207488:12345-192.168.201.38@tcp:2:touch.500 00000100:00100000:1.0:1787855824.504272:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:0:x1874702464207488:12345-192.168.201.38@tcp:2:touch.500 Request processed in 56010us (56558us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787855824.504288:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:3.0:1787855824.506987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855824.507036:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464207744 00000100:00100000:3.0:1787855824.507048:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464207744 00000100:00100000:3.0:1787855824.507118:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:3.0:1787855824.507131:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1320780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+10:9681:x1874702464207744:12345-192.168.201.38@tcp:35:touch.500 00000100:00100000:3.0:1787855824.507858:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1320780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+11:9681:x1874702464207744:12345-192.168.201.38@tcp:35:touch.500 Request processed in 723us (880us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787855824.507868:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00000001:00080000:2.0:1787855824.510488:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1787855824.510514:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6933b672-fa85-4aae-9dc8-092c3f355bbf 00000100:00100000:1.0:1787855824.525634:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855824.525753:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464207872 00000100:00100000:2.0:1787855824.525766:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464207872 00000100:00100000:2.0:1787855824.525891:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:2.0:1787855824.525903:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+11:9682:x1874702464207872:12345-192.168.201.38@tcp:101:rm.0 00010000:00010000:2.0:1787855824.525936:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855824.525964:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d795 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616ad0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.526055:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046200/0x516929ca3366d79c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.526073:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046200/0x516929ca3366d79c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.526087:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046200/0x516929ca3366d79c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855824.526176:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787855824.526181:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787855824.526240:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046200/0x516929ca3366d79c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.526275:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d795 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ad0 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.526299:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046200/0x516929ca3366d79c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ad0 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.526532:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a73c7093400) 00010000:00010000:2.0:1787855824.526536:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787855824.526541:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402046200, rc 0) 00000100:00100000:3.0:1787855824.526952:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+12:9682:x1874702464207872:12345-192.168.201.38@tcp:101:rm.0 Request processed in 1047us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855824.526962:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:0.0:1787855824.530875:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855824.530996:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464208128 00000100:00100000:2.0:1787855824.531010:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464208128 00000100:00100000:2.0:1787855824.531091:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 26 00000100:00100000:2.0:1787855824.531110:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+12:9682:x1874702464208128:12345-192.168.201.38@tcp:101:rm.0 00010000:00010000:2.0:1787855824.531138:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855824.531178:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d7a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616ad7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855824.531353:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787855824.531583:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d7a3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ad7 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.531602:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:2.0:1787855824.531606:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787855824.531627:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d7a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ad7 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855824.531644:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402046000, rc 0) 00000100:00100000:2.0:1787855824.531726:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:9682:x1874702464208128:12345-192.168.201.38@tcp:101:rm.0 Request processed in 618us (866us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787855824.531735:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 26 00000100:00100000:0.0:1787855824.540139:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855824.540330:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464208256 00000100:00100000:3.0:1787855824.540344:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464208256 00000100:00100000:3.0:1787855824.540425:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:3.0:1787855824.540438:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:9682:x1874702464208256:12345-192.168.201.38@tcp:37:rm.0 00000100:00100000:1.0:1787855824.553764:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:9682:x1874702464208256:12345-192.168.201.38@tcp:37:rm.0 Request processed in 13310us (13625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855824.557679:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:1.0:1787855824.558881:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855824.559004:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464208512 00000100:00100000:0.0:1787855824.559017:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464208512 00000100:00100000:0.0:1787855824.559117:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:0.0:1787855824.559129:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73dc263850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:9682:x1874702464208512:12345-192.168.201.38@tcp:35:rm.0 00000100:00100000:0.0:1787855824.559760:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73dc263850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:9682:x1874702464208512:12345-192.168.201.38@tcp:35:rm.0 Request processed in 629us (883us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787855824.559772:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:0.0:1787855824.565097:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855824.565376:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464208768 00000100:00100000:1.0:1787855824.565389:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464208768 00000100:00100000:1.0:1787855824.565477:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:1.0:1787855824.565490:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:9682:x1874702464208768:12345-192.168.201.38@tcp:101:rm.0 00010000:00010000:1.0:1787855824.565524:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855824.565553:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d7b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616ade expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.565730:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366d7b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.565748:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366d7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.565762:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366d7b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855824.565807:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787855824.565975:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d7b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ade expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.565998:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366d7b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ade expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.566008:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a73c7093400) 00010000:00010000:1.0:1787855824.566011:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787855824.566015:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe600, rc 0) 00000100:00100000:1.0:1787855824.566105:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+16:9682:x1874702464208768:12345-192.168.201.38@tcp:101:rm.0 Request processed in 616us (1023us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787855824.566136:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:3.0:1787855824.573915:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855824.574040:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464208896 00000100:00100000:2.0:1787855824.574055:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464208896 00000100:00100000:2.0:1787855824.574168:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:2.0:1787855824.574182:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1321680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+16:9682:x1874702464208896:12345-192.168.201.38@tcp:41:rm.0 00000004:00000024:2.0:1787855824.574283:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787855824.574666:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1321680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+16:9682:x1874702464208896:12345-192.168.201.38@tcp:41:rm.0 Request processed in 486us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855824.574677:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:0.0:1787855824.579339:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855824.579468:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464209024 00000100:00100000:1.0:1787855824.579481:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464209024 00000100:00100000:1.0:1787855824.579555:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:1.0:1787855824.579568:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+16:9682:x1874702464209024:12345-192.168.201.38@tcp:101:rm.0 00010000:00010000:1.0:1787855824.579594:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855824.579624:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d7c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616ae5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.579713:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.579733:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.579746:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.579763:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.579770:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.579827:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.579977:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580009:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580016:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855824.580053:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787855824.580058:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787855824.580083:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580096:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580106:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580113:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580119:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580126:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855824.580130:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580139:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580154:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a73c7093400) 00010000:00010000:1.0:1787855824.580166:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855824.580179:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580187:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580203:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580210:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580216:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580222:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855824.580225:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580231:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580239:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb7cbccd0 (ffff9a73c8d1d900) 00010000:00010000:1.0:1787855824.580241:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855824.580244:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580250:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580285:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d7c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ae5 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580314:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ae5 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.580323:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a73c7093600) 00010000:00010000:1.0:1787855824.580325:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787855824.580328:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fee00, rc 0) 00000100:00100000:1.0:1787855824.580408:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+17:9682:x1874702464209024:12345-192.168.201.38@tcp:101:rm.0 Request processed in 842us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855824.580416:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:0.0:1787855824.588360:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855824.589106:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464209280 00000100:00100000:1.0:1787855824.589121:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464209280 00000100:00100000:1.0:1787855824.589464:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:1.0:1787855824.589478:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+17:9682:x1874702464209280:12345-192.168.201.38@tcp:36:rm.0 00010000:00010000:1.0:1787855824.589559:0:9629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787855824.589596:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ae5 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.589756:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046c00/0x516929ca3366d787 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ac9 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.589770:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a73c7093600) 00010000:00010000:1.0:1787855824.589834:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046200/0x516929ca3366d79c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ad0 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.589843:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a73c7093400) 00010000:00010000:1.0:1787855824.589864:0:9629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787855824.589889:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d7e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.589905:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d7e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.589916:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d7e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.589932:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.589939:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.589945:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.590153:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7f0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.590172:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.590178:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787855824.592560:0:9629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787855824.592588:0:9629:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 315444811525ns, next at 316444805250ns, rc = 0 00010000:00010000:1.0:1787855824.592956:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d7f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.592992:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d7f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593006:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d7f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593017:0:9629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d7f7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593024:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d7f7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593031:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d7f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593048:0:9629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787855824.593076:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593082:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7f0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593088:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593094:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855824.593099:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593107:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7f0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593134:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a73c8d1d200) 00010000:00010000:1.0:1787855824.593137:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787855824.593143:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7f0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593151:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366d7f0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593191:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d7e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593198:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d7e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593205:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d7e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.593438:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855824.593513:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d7f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.593521:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffe00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855824.593525:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d7f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.593532:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d7f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.593543:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a73c8d1d200) 00010000:00010000:0.0:1787855824.593546:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787855824.593549:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d7f7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.593555:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366d7f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.593571:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855824.593579:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855824.593581:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855824.593747:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fea00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855824.593751:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d7e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593758:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d7e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593767:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a73c7093400) 00010000:00010000:1.0:1787855824.593770:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855824.593895:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d7e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.593903:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d7e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787855824.593928:0:9629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060d18917 reply state 00000000d04f8a71 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855824.593939:0:9629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787855824.594113:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+16:9682:x1874702464209280:12345-192.168.201.38@tcp:36:rm.0 Request processed in 4632us (5763us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787855824.594124:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 30 00010000:00010000:1.0:1787855824.600292:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.600323:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.600332:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.600339:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855824.600352:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.600360:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.600382:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb7cbccd0 (ffff9a73c8d1d900) 00010000:00010000:1.0:1787855824.600386:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855824.600391:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.600398:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d7e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855824.602177:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855824.602750:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464209536 00000100:00100000:1.0:1787855824.602764:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464209536 00000100:00100000:1.0:1787855824.602871:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:1.0:1787855824.602884:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:9682:x1874702464209536:12345-192.168.201.38@tcp:35:rm.0 00000100:00100000:1.0:1787855824.603915:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+16:9682:x1874702464209536:12345-192.168.201.38@tcp:35:rm.0 Request processed in 1026us (1753us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787855824.603928:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:0.0:1787855824.608176:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855824.608539:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464209792 00000100:00100000:1.0:1787855824.608554:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464209792 00000100:00100000:1.0:1787855824.608924:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:1.0:1787855824.608940:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+16:9682:x1874702464209792:12345-192.168.201.38@tcp:36:rm.0 00010000:00010000:1.0:1787855824.609032:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787855824.609075:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366d7b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ade expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.609105:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d756 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616abb expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.609120:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a73c7093400) 00010000:00010000:1.0:1787855824.609140:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366d717 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616aad expref: 14 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.609150:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:1.0:1787855824.609167:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787855824.609199:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.609528:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.609542:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.609562:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d805 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.609570:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d805 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.609577:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d805 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.610271:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366d80c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.610284:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366d80c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.610293:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366d80c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855824.612544:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787855824.612578:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366d80c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.612590:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366d80c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.612598:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366d80c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.612754:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855824.612760:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366d80c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.612770:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366d80c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.612812:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a73c8d1da00) 00010000:00010000:1.0:1787855824.612815:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787855824.612821:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366d80c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.612827:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366d80c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.612860:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.612866:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.612871:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.612875:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fee00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855824.612878:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.612883:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.612901:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c8d1dc00) 00010000:00010000:1.0:1787855824.612904:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855824.612907:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.612912:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366d7fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787855824.612925:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5b81efc reply state 00000000ba2e88cf transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d805 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855824.612933:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787855824.613113:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:9682:x1874702464209792:12345-192.168.201.38@tcp:36:rm.0 Request processed in 4171us (4955us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787855824.613124:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 31 00010000:00010000:1.0:1787855824.618227:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d805 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.618251:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d805 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.618259:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d805 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.618274:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fec00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855824.618280:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d805 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.618289:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d805 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.618340:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a73c8d1dd00) 00010000:00010000:1.0:1787855824.618343:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855824.618349:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d805 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855824.618355:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366d805 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855824.636065:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855825.663551:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855826.695768:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787855827.068044:0:6983:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 317920263921ns, next at 318920260443ns, rc = 0 00000100:00100000:0.0:1787855827.068095:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787855827.068136:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486261120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787855827.068537:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855827.068592:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486261120 00000100:00100000:3.0:1787855827.068603:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486261120 00000100:00100000:3.0:1787855827.068681:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787855827.068693:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486261120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787855827.068739:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855827.068816:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486261120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855827.068824:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1787855827.068840:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73f764b480 x1874702486261120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855827.068864:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486261120:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787855827.068895:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787855827.365479:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855827.365523:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855827.365567:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855827.365608:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855827.365735:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464209920 00000100:00100000:3.0:1787855827.365748:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464209920 00000100:00100000:3.0:1787855827.365873:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 248 00000100:00100000:3.0:1787855827.365887:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2357:x1874702464209920:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855827.365989:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4973850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2357:x1874702464209920:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 105us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855827.365997:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 248 00000100:00100000:3.0:1787855827.366044:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464210176 00000100:00100000:3.0:1787855827.366050:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464210176 00000100:00100000:3.0:1787855827.366099:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:3.0:1787855827.366106:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464210176:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855827.366148:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464210176:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 42us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855827.366155:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00080000:3.0:1787855827.366377:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787855827.366492:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464210048 00000100:00100000:1.0:1787855827.366498:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464210048 00000100:00100000:1.0:1787855827.366553:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464210304 00000100:00100000:1.0:1787855827.366556:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464210304 00000100:00100000:1.0:1787855827.366579:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:1.0:1787855827.366587:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:2357:x1874702464210048:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855827.366637:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:2357:x1874702464210048:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 51us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855827.366645:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:1.0:1787855827.366664:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 100 00000100:00100000:1.0:1787855827.366671:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464210304:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855827.366697:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464210304:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855827.366703:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 100 00000100:00080000:3.0:1787855827.366928:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855827.581998:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9280b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486261376:0@lo:400:kworker.0 00000100:00100000:1.0:1787855827.582084:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855827.582145:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486261888:0@lo:400:kworker.0 00000100:00100000:1.0:1787855827.582171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855827.582202:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787855827.582208:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486261248:0@lo:400:kworker.0 00000100:00100000:1.0:1787855827.582234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855827.582255:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486261760:0@lo:400:kworker.0 00000100:00100000:1.0:1787855827.582275:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855827.582298:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486261632:0@lo:400:kworker.0 00000100:00100000:1.0:1787855827.582320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855827.582338:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787855827.582344:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486261504:0@lo:400:kworker.0 00000100:00100000:1.0:1787855827.582380:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855827.582412:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486261376 00000100:00100000:1.0:1787855827.582420:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486261376 00000100:00100000:1.0:1787855827.582459:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486261760 00000100:00100000:1.0:1787855827.582462:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486261760 00000100:00100000:1.0:1787855827.582485:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486261504 00000100:00100000:1.0:1787855827.582487:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486261504 00000100:00100000:1.0:1787855827.582503:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787855827.582512:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c33561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486261376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855827.582564:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c33561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486261376:12345-0@lo:400:kworker.0 Request processed in 53us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855827.582572:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787855827.582588:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787855827.582595:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3356d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486261760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855827.582633:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3356d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486261760:12345-0@lo:400:kworker.0 Request processed in 39us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855827.582640:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787855827.582653:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787855827.582659:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486261504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855827.582688:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486261504:12345-0@lo:400:kworker.0 Request processed in 30us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855827.582694:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787855827.582712:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486261888 00000100:00100000:1.0:1787855827.582715:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486261888 00000100:00100000:1.0:1787855827.582740:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486261632 00000100:00100000:1.0:1787855827.582743:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486261632 00000100:00100000:1.0:1787855827.582761:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787855827.582767:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486261888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855827.582821:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486261888:12345-0@lo:400:kworker.0 Request processed in 53us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855827.582827:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787855827.582839:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787855827.582845:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3357c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486261632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855827.582874:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3357c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486261632:12345-0@lo:400:kworker.0 Request processed in 29us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855827.582880:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787855827.582897:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486261248 00000100:00100000:1.0:1787855827.582900:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486261248 00000100:00100000:1.0:1787855827.582923:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787855827.582928:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486261248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855827.582970:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4970c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486261248:12345-0@lo:400:kworker.0 Request processed in 41us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855827.582976:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:1.0:1787855827.583016:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787855827.583021:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855827.583055:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9281680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486261504:0@lo:400:kworker.0 00010000:00080000:1.0:1787855827.583068:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73c9283480 x1874702486261632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855827.583079:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9283480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486261632:0@lo:400:kworker.0 00000100:00100000:1.0:1787855827.583121:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486261248:0@lo:400:kworker.0 00000100:00100000:1.0:1787855827.583132:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486261760:0@lo:400:kworker.0 00000100:00100000:1.0:1787855827.583141:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9280b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486261376:0@lo:400:kworker.0 00010000:00080000:1.0:1787855827.583150:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a72c3354f00 x1874702486261888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855827.583159:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3354f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486261888:0@lo:400:kworker.0 00010000:00010000:3.0:1787855827.708630:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855828.096502:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1321e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486262016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787855828.096576:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855828.096712:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486262016 00000100:00100000:1.0:1787855828.096720:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486262016 00000100:00100000:1.0:1787855828.096797:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787855828.096819:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486262016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787855828.096855:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787855828.105010:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486262016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8193us (8422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855828.107902:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1787855828.117825:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73d1321e00 x1874702486262016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855828.117856:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1321e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486262016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787855828.731942:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787855829.248539:0:11602:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:3.0:1787855829.706308:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000004:00080000:3.0:1787855829.706331:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1787855829.706352:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1787855829.706361:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787855829.706545:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787855829.706565:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f763e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486262144:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787855829.706636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855829.706707:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486262144 00000100:00100000:0.0:1787855829.706714:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486262144 00000100:00100000:0.0:1787855829.706769:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787855829.706801:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d8960780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486262144:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787855829.706828:0:6680:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787855829.706864:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9083d0, atime: 0x6a9083d0, ctime: 0x6a9083d0, blocks: 0x1 00010000:00010000:0.0:1787855829.706887:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366d813 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855829.706906:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=320s v=(0 0) 00010000:00010000:0.0:1787855829.706910:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787855829.706917:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366d813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855829.706934:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366d813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855829.706945:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366d813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855829.706954:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366d813 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855829.706967:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787855829.708519:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d8960780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874702486262144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1715us (1878us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787855829.708531:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787855829.708562:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787855829.708638:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787855829.708647:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366d813 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855829.708658:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143400 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787855829.708663:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366d813 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855829.708687:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366d813 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855829.708709:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366d813 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855829.708718:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366d813 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855829.708742:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855829.708744:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855829.708745:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787855829.708944:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a73f763e940/2, rc 0, transno 4294967300 00000100:00100000:2.0:1787855829.708952:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f763e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486262144:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787855829.756086:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787855830.610803:0:11652:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde4671b30 20000000:00000080:2.0:1787855830.610821:0:11652:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a72c3080c00 uarg=0000000000000000 20000000:01000000:2.0:1787855830.610853:0:11652:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787855830.610860:0:11652:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787855830.610865:0:11652:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787855830.611724:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787855830.611882:0:11652:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787855830.615662:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787855830.615725:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787855830.616098:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787855830.616116:0:11652:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787855830.616136:0:11652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a73d1229400/0x516929ca3366d81a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.616223:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73d1229000/0x516929ca3366d6bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d6b5 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.616232:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73d1229c00/0x516929ca3366d6ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d6c3 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.616239:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d6d1 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.616260:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73d1228800/0x516929ca3366d6df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a98 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.616267:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73d1229600/0x516929ca3366d6e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a9f expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.616274:0:11652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a73d1229400/0x516929ca3366d81a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.616313:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73d1229600/0x516929ca3366d6e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a9f expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.616326:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a73d1229600/0x516929ca3366d6e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a9f expref: 12 pid: 5828 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855830.616341:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1321e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874702486262272:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787855830.616483:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73d1228800/0x516929ca3366d6df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a98 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.616492:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a73d1228800/0x516929ca3366d6df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a98 expref: 12 pid: 5826 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855830.616500:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1320780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874702486262400:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787855830.616528:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d6d1 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.616535:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d6d1 expref: 18 pid: 5826 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855830.616555:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1320f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874702486262528:0@lo:104: 00000100:00100000:3.0:1787855830.616590:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787855830.616664:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73d1229c00/0x516929ca3366d6ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d6c3 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.616673:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a73d1229c00/0x516929ca3366d6ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d6c3 expref: 18 pid: 5828 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855830.616680:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874702486262656:0@lo:104: 00000100:00100000:3.0:1787855830.616703:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787855830.622422:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73d1229000/0x516929ca3366d6bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366d6b5 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.622440:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a73d1229000/0x516929ca3366d6bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366d6b5 expref: 18 pid: 5826 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855830.622455:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400694000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874702486262784:0@lo:104: 00000100:00100000:3.0:1787855830.622511:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855830.622744:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486262528 00000100:00100000:1.0:1787855830.622752:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486262528 00000100:00100000:1.0:1787855830.622853:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486262656 00000100:00100000:1.0:1787855830.622857:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486262656 00000100:00100000:2.0:1787855830.622912:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787855830.622925:0:7617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1322940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+4:11652:x1874702486262528:12345-0@lo:104: 00010000:00010000:2.0:1787855830.622938:0:7617:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a7402046e00/0x516929ca3366d6d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d6d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855830.623002:0:7617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787855830.623007:0:7617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1322940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+4:11652:x1874702486262528:12345-0@lo:104: Request processed in 88us (6418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855830.623014:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787855830.623043:0:7617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787855830.623049:0:7617:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa095a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:11652:x1874702486262656:12345-0@lo:104: 00010000:00010000:2.0:1787855830.623069:0:7617:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73c0031000/0x516929ca3366d6c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d6ca expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855830.623102:0:7617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787855830.623107:0:7617:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa095a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:11652:x1874702486262656:12345-0@lo:104: Request processed in 59us (6403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855830.623113:0:7617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787855830.623398:0:11652:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa19f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787855830.623419:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1320f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874702486262528:0@lo:104: 00000100:00100000:3.0:1787855830.623427:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874702486262656:0@lo:104: 00000100:00100000:0.0:1787855830.623513:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787855830.623525:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486262784 00000100:00100000:0.0:1787855830.623529:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486262784 00000100:00100000:0.0:1787855830.623548:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787855830.623554:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c308f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:11652:x1874702486262784:12345-0@lo:104: 00010000:00010000:0.0:1787855830.623562:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73c5142200/0x516929ca3366d6b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d6bc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855830.623610:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787855830.623615:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c308f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2adc339-cccb-4166-8f83-87a1e9e399f1+3:11652:x1874702486262784:12345-0@lo:104: Request processed in 62us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855830.623623:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787855830.623710:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400694000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874702486262784:0@lo:104: 00000100:00100000:1.0:1787855830.623741:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:3.0:1787855830.625889:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787855830.625902:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402046e00/0x516929ca3366d6d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d6d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.625913:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402046e00 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:3.0:1787855830.625932:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402046e00/0x516929ca3366d6d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d6d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.625942:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402046e00/0x516929ca3366d6d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d6d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787855830.625949:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402046e00/0x516929ca3366d6d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d6d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855830.625954:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787855830.626002:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402046e00/0x516929ca3366d6d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d6d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626009:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787855830.626032:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402046e00/0x516929ca3366d6d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d6d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626039:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402046e00/0x516929ca3366d6d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d6d8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626065:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787855830.626068:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c0031000/0x516929ca3366d6c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d6ca expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626074:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c0031000 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:3.0:1787855830.626077:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c0031000/0x516929ca3366d6c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d6ca expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626083:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c0031000/0x516929ca3366d6c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d6ca expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787855830.626098:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c0031000/0x516929ca3366d6c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d6ca expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855830.626105:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787855830.626118:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c0031000/0x516929ca3366d6c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d6ca expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626124:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787855830.626129:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c0031000/0x516929ca3366d6c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d6ca expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626135:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c0031000/0x516929ca3366d6c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d6ca expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626145:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787855830.626158:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c5142200/0x516929ca3366d6b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366d6bc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626165:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142200 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:3.0:1787855830.626168:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5142200/0x516929ca3366d6b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366d6bc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626173:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c5142200/0x516929ca3366d6b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366d6bc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787855830.626179:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5142200/0x516929ca3366d6b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366d6bc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855830.626183:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787855830.626200:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c5142200/0x516929ca3366d6b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d6bc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626206:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787855830.626225:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c5142200/0x516929ca3366d6b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d6bc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626233:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c5142200/0x516929ca3366d6b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366d6bc expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626246:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855830.626248:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855830.626249:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855830.626264:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400697c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486262912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787855830.626334:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855830.626374:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787855830.626380:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400695680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486263040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787855830.626411:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855830.626434:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787855830.626442:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400695e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486263168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787855830.626465:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855830.626489:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486262912 00000100:00100000:3.0:1787855830.626495:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486262912 00010000:00010000:3.0:1787855830.626522:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d6d1 expref: 19 pid: 5826 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855830.626544:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486263040 00000100:00100000:3.0:1787855830.626547:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486263040 00010000:00010000:3.0:1787855830.626556:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73d1229c00/0x516929ca3366d6ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d6c3 expref: 20 pid: 5828 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855830.626576:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486263168 00000100:00100000:3.0:1787855830.626578:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486263168 00010000:00010000:3.0:1787855830.626590:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73d1229000/0x516929ca3366d6bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d6b5 expref: 21 pid: 5826 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855830.626601:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787855830.626608:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+21:3304:x1874702486262912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787855830.626620:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855830.626625:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d6d1 expref: 21 pid: 5826 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626634:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d6d1 expref: 21 pid: 5826 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626647:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c0031400/0x516929ca3366d6d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d6d1 expref: 21 pid: 5826 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626660:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855830.626689:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+20:3304:x1874702486262912:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855830.626696:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787855830.626711:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787855830.626717:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486263040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787855830.626724:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855830.626728:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73d1229c00/0x516929ca3366d6ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d6c3 expref: 19 pid: 5828 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626735:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73d1229c00/0x516929ca3366d6ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d6c3 expref: 19 pid: 5828 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626750:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73d1229c00/0x516929ca3366d6ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d6c3 expref: 19 pid: 5828 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626759:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855830.626801:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:3304:x1874702486263040:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855830.626807:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787855830.626818:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787855830.626824:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c53dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:3307:x1874702486263168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787855830.626831:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855830.626835:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73d1229000/0x516929ca3366d6bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366d6b5 expref: 17 pid: 5826 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626843:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73d1229000/0x516929ca3366d6bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366d6b5 expref: 17 pid: 5826 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626853:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73d1229000/0x516929ca3366d6bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366d6b5 expref: 17 pid: 5826 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.626860:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855830.626882:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c53dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:3307:x1874702486263168:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855830.626888:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787855830.626936:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400695e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486263168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787855830.626956:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400695680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486263040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787855830.626963:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400697c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486262912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787855830.635571:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855830.635634:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855830.635660:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464210560 00000100:00100000:3.0:1787855830.635668:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464210560 00010000:00010000:3.0:1787855830.635702:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73d1228800/0x516929ca3366d6df lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a98 expref: 13 pid: 5826 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855830.635722:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464210432 00000100:00100000:3.0:1787855830.635725:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464210432 00010000:00010000:3.0:1787855830.635735:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73d1229600/0x516929ca3366d6e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a9f expref: 14 pid: 5828 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855830.635748:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:3.0:1787855830.635755:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d78451b-7acd-4478-9bc5-3a00d72e2604+14:2357:x1874702464210560:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787855830.635766:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855830.635771:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73d1228800/0x516929ca3366d6df lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a98 expref: 14 pid: 5826 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.635798:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73d1228800/0x516929ca3366d6df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a98 expref: 14 pid: 5826 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.635818:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855830.635864:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d78451b-7acd-4478-9bc5-3a00d72e2604+14:2357:x1874702464210560:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 109us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855830.635871:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:3.0:1787855830.635886:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:3.0:1787855830.635891:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2357:x1874702464210432:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787855830.635898:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855830.635916:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73d1229600/0x516929ca3366d6e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a9f expref: 13 pid: 5828 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.635925:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73d1229600/0x516929ca3366d6e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a9f expref: 13 pid: 5828 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.635937:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a73d1229400/0x516929ca3366d81a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.635945:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1229400/0x516929ca3366d81a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.635959:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73d1229400/0x516929ca3366d81a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.635966:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73d1229400/0x516929ca3366d81a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.635973:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a73d1229400/0x516929ca3366d81a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.635979:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a73d1229400/0x516929ca3366d81a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.635985:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229400 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787855830.635988:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a73d1229400/0x516929ca3366d81a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.635996:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a73d1229400/0x516929ca3366d81a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.636004:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a73d1229400/0x516929ca3366d81a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.636019:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855830.636036:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2357:x1874702464210432:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 145us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855830.636042:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 34 00010000:00010000:3.0:1787855830.636099:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73d1229600/0x516929ca3366d6e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a9f expref: 12 pid: 5828 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855830.636113:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1321e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874702486262272:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787855830.636123:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73d1228800/0x516929ca3366d6df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a98 expref: 11 pid: 5826 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855830.636130:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1320780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1874702486262400:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787855830.636164:0:11652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a73d1229400/0x516929ca3366d81a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.636173:0:11652:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a73d1229400/0x516929ca3366d81a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.636179:0:11652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a73d1229400/0x516929ca3366d81a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.636186:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73d1229400/0x516929ca3366d81a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855830.641359:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855830.641794:0:7617:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:3.0:1787855830.783233:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855831.805988:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855832.188387:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787855832.188413:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486263296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787855832.188490:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855832.188736:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486263296 00000100:00100000:0.0:1787855832.188744:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486263296 00000100:00100000:0.0:1787855832.188832:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787855832.188842:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874702486263296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787855832.188876:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855832.188919:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874702486263296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855832.188925:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787855832.189097:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787855832.189269:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486263296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855832.294616:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855832.294887:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464210688 00000100:00100000:1.0:1787855832.294899:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464210688 00000100:00100000:1.0:1787855832.294973:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 250 00000100:00100000:1.0:1787855832.294984:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:5598:x1874702464210688:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787855832.295005:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855832.295045:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73fa6ff600/0x516929ca3366d821 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616aec expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855832.295082:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73fa6ff600/0x516929ca3366d821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616aec expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855832.295096:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73fa6ff600/0x516929ca3366d821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616aec expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855832.295108:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ff600, rc 0) 00000100:00100000:1.0:1787855832.295192:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4970850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:5598:x1874702464210688:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 209us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855832.295201:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 250 00000100:00100000:2.0:1787855832.297453:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855832.297570:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464210816 00000100:00100000:1.0:1787855832.297582:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464210816 00000100:00100000:1.0:1787855832.297658:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 251 00000100:00100000:1.0:1787855832.297689:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:5598:x1874702464210816:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787855832.298075:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:5598:x1874702464210816:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 388us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855832.298085:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 251 00000100:00100000:3.0:1787855832.300035:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855832.300162:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464210944 00000100:00100000:2.0:1787855832.300182:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464210944 00000100:00100000:2.0:1787855832.300253:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 252 00000100:00100000:2.0:1787855832.300266:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:5598:x1874702464210944:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787855832.300542:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4971850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:5598:x1874702464210944:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 278us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855832.300551:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 252 00000100:00100000:3.0:1787855832.304918:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855832.305041:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464211072 00000100:00100000:0.0:1787855832.305057:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464211072 00000100:00100000:0.0:1787855832.305133:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 253 00000100:00100000:0.0:1787855832.305146:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:9952:x1874702464211072:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787855832.306699:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4973050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:9952:x1874702464211072:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 1539us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855832.306714:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 253 00000100:00100000:3.0:1787855832.313824:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855832.313952:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464211200 00000100:00100000:1.0:1787855832.313968:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464211200 00000100:00100000:1.0:1787855832.314055:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 254 00000100:00100000:1.0:1787855832.314069:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:9952:x1874702464211200:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787855832.314436:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4971050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:9952:x1874702464211200:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 368us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855832.314445:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 254 00000100:00100000:3.0:1787855832.317663:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855832.319406:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464211328 00000100:00100000:2.0:1787855832.319425:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464211328 00000100:00100000:2.0:1787855832.319522:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 255 00000100:00100000:2.0:1787855832.319535:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f4971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+12:5598:x1874702464211328:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787855832.319583:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855832.319772:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a7402047200/0x516929ca3366d828 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616af3 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855832.319892:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a7402047200/0x516929ca3366d828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616af3 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855832.319909:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a7402047200/0x516929ca3366d828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616af3 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855832.319920:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402047200, rc 0) 00000100:00100000:2.0:1787855832.320070:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f4971c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:5598:x1874702464211328:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 537us (2422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855832.320078:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 255 00000100:00100000:3.0:1787855832.322446:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855832.322539:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464211456 00000100:00100000:1.0:1787855832.322551:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464211456 00000100:00100000:1.0:1787855832.322634:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 256 00000100:00100000:1.0:1787855832.322647:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c446b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:5598:x1874702464211456:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787855832.323742:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c446b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:5598:x1874702464211456:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 1087us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855832.323754:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 256 00000100:00100000:3.0:1787855832.329966:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855832.330057:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464211584 00000100:00100000:2.0:1787855832.330070:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464211584 00000100:00100000:2.0:1787855832.330144:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 257 00000100:00100000:2.0:1787855832.330156:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c446a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:5598:x1874702464211584:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787855832.330523:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c446a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:5598:x1874702464211584:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 368us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855832.330532:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 257 00000100:00100000:0.0:1787855832.335111:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855832.336078:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464211712 00000100:00100000:1.0:1787855832.336094:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464211712 00000100:00100000:1.0:1787855832.336289:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 258 00000100:00100000:1.0:1787855832.336303:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:9955:x1874702464211712:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787855832.336832:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4468050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:9955:x1874702464211712:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 529us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855832.336856:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 258 00000100:00100000:0.0:1787855832.342996:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855832.343285:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464211840 00000100:00100000:2.0:1787855832.343298:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464211840 00000100:00100000:2.0:1787855832.343400:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 259 00000100:00100000:2.0:1787855832.343411:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:9955:x1874702464211840:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787855832.343678:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4468450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:9955:x1874702464211840:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 268us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855832.343691:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 259 10000000:01000000:0.0:1787855832.443925:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787855832.443936:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73e762a800 from 7 10000000:01000000:0.0:1787855832.443943:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787855832.444041:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855832.444081:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855832.444097:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855832.444148:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1320b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486263424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787855832.444248:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855832.444382:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73f44a5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787855832.444679:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486263424 00000100:00100000:1.0:1787855832.444689:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486263424 00000100:00100000:1.0:1787855832.445001:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787855832.445014:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:5830:x1874702486263424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787855832.445042:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855832.445059:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366d836 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d82f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855832.445093:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366d836 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d82f expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855832.445106:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366d836 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d82f expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855832.445129:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ff000, rc 0) 00000100:00100000:1.0:1787855832.445210:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4469050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486263424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855832.445219:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787855832.445321:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1320b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486263424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855832.445340:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855832.445351:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855832.445428:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486263552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855832.445463:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855832.446053:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa19f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855832.446318:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486263552 00000100:00100000:2.0:1787855832.446326:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486263552 00000100:00100000:2.0:1787855832.446370:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787855832.446383:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486263552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787855832.446746:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4469850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486263552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855832.446755:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787855832.446947:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486263552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855832.447008:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486263680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787855832.447082:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855832.447113:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa19f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855832.447242:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486263680 00000100:00100000:2.0:1787855832.447249:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486263680 00000100:00100000:2.0:1787855832.447275:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787855832.447283:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c446b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486263680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787855832.447447:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c446b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486263680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855832.447454:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787855832.447525:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486263680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787855832.448061:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:11665:1874702486263808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855832.448102:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855832.448244:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa19fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787855832.448455:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486263808 00000100:00100000:1.0:1787855832.448461:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486263808 00000100:00100000:2.0:1787855832.448516:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787855832.448526:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c446a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:11665:x1874702486263808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787855832.448713:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c446a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:11665:x1874702486263808:12345-0@lo:502:llog_process_th.0 Request processed in 189us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855832.448721:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787855832.448877:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:11665:1874702486263808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787855832.448921:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787855832.448933:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855832.448936:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787855832.448943:0:11665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a73e762a800 00000020:00000080:3.0:1787855832.448946:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787855832.449062:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:11665:1874702486263936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855832.449100:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855832.449562:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa19fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787855832.452923:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486263936 00000100:00100000:0.0:1787855832.452939:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486263936 00000100:00100000:0.0:1787855832.453019:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787855832.453042:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:11665:x1874702486263936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855832.454657:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:11665:x1874702486263936:12345-0@lo:502:llog_process_th.0 Request processed in 1604us (5543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855832.454672:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787855832.458296:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:11665:1874702486263936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787855832.458394:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787855832.458408:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855832.458411:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787855832.458417:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787855832.461309:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787855832.461359:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787855832.461375:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855832.461407:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855832.461420:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787855832.461424:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73d0d01000 from 7 10000000:01000000:2.0:1787855832.461428:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787855832.461480:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855832.461490:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855832.461503:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855832.461538:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486264064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787855832.461629:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855832.461757:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50a3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787855832.464574:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486264064 00000100:00100000:0.0:1787855832.464597:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486264064 00000100:00100000:0.0:1787855832.464687:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787855832.464700:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:5830:x1874702486264064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787855832.464725:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855832.464749:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c5143600/0x516929ca3366d844 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d83d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855832.464821:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c5143600/0x516929ca3366d844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d83d expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855832.464852:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c5143600/0x516929ca3366d844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d83d expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855832.464864:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143600, rc 0) 00000100:00100000:0.0:1787855832.464972:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486264064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 274us (3343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855832.464981:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787855832.465066:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486264064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787855832.465090:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d844 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855832.465102:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d844 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855832.465454:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1320780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486264192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787855832.465498:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855832.465541:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73f44a5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787855832.465600:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486264192 00000100:00100000:1.0:1787855832.465606:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486264192 00000100:00100000:1.0:1787855832.465647:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787855832.465657:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486264192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787855832.466043:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486264192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 385us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855832.466064:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787855832.466173:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1320780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486264192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855832.466213:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486264320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787855832.466259:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855832.466289:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa19fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787855832.466441:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486264320 00000100:00100000:1.0:1787855832.466447:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486264320 00000100:00100000:1.0:1787855832.466493:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787855832.466502:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486264320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787855832.466667:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486264320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855832.466675:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787855832.467082:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486264320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787855832.467651:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1321e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:11668:1874702486264448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855832.467703:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855832.467743:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73f44a5300 going to sleep for 11 seconds 00000100:00100000:1.0:1787855832.467868:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486264448 00000100:00100000:1.0:1787855832.467874:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486264448 00000100:00100000:1.0:1787855832.467916:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787855832.467927:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:11668:x1874702486264448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787855832.468219:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:11668:x1874702486264448:12345-0@lo:502:llog_process_th.0 Request processed in 293us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855832.468228:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787855832.468332:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1321e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:11668:1874702486264448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787855832.468362:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787855832.468375:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855832.468378:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787855832.468386:0:11668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a73d0d01000 00000020:00000080:3.0:1787855832.468389:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787855832.468487:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:11668:1874702486264576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855832.468538:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855832.468567:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486264576 00000100:00100000:3.0:1787855832.468571:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486264576 00000100:00100000:3.0:1787855832.468598:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787855832.468605:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:11668:x1874702486264576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855832.468739:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:11668:x1874702486264576:12345-0@lo:502:llog_process_th.0 Request processed in 134us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855832.468747:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787855832.468900:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa19fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787855832.468914:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:11668:1874702486264576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787855832.468932:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787855832.468936:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855832.468938:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787855832.468942:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787855832.469031:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787855832.469054:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787855832.469066:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d844 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855832.469079:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d844 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855832.469093:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787855832.469096:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73f4b59000 from 7 10000000:01000000:3.0:1787855832.469100:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787855832.470218:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855832.470237:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855832.470261:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855832.470288:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486264704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787855832.470353:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855832.470408:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa19fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787855832.470707:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486264704 00000100:00100000:0.0:1787855832.470715:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486264704 00000100:00100000:0.0:1787855832.470802:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1787855832.470814:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:5830:x1874702486264704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787855832.470830:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855832.470855:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c5142600/0x516929ca3366d852 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366d84b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855832.470888:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c5142600/0x516929ca3366d852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366d84b expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855832.470900:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c5142600/0x516929ca3366d852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366d84b expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855832.470910:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142600, rc 0) 00000100:00100000:0.0:1787855832.470964:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486264704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855832.470971:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787855832.471222:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486264704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787855832.471242:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d852 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855832.471254:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d852 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855832.471340:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486264832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787855832.471377:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855832.471403:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa998000 going to sleep for 11 seconds 00000100:00100000:0.0:1787855832.471474:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486264832 00000100:00100000:0.0:1787855832.471479:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486264832 00000100:00100000:0.0:1787855832.471513:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787855832.471521:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486264832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787855832.473111:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486264832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1579us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855832.473202:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787855832.473253:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486264832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787855832.473314:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486264960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787855832.473377:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855832.473428:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa998000 going to sleep for 11 seconds 00000100:00100000:0.0:1787855832.473653:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486264960 00000100:00100000:0.0:1787855832.473660:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486264960 00000100:00100000:0.0:1787855832.473711:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787855832.473721:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486264960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787855832.474173:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:5830:x1874702486264960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 451us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855832.474183:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787855832.476319:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2adc339-cccb-4166-8f83-87a1e9e399f1:5830:1874702486264960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787855832.477083:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbd680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:11669:1874702486265088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787855832.477197:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855832.477254:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa998cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855832.477392:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486265088 00000100:00100000:0.0:1787855832.477408:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486265088 00000100:00100000:0.0:1787855832.477471:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787855832.477482:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:11669:x1874702486265088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855832.477809:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:11669:x1874702486265088:12345-0@lo:502:llog_process_th.0 Request processed in 327us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855832.477818:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787855832.477882:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbd680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:11669:1874702486265088:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787855832.477914:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787855832.477926:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855832.477929:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787855832.477938:0:11669:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a73f4b59000 00000020:00000080:0.0:1787855832.477940:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787855832.478630:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1320f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:11669:1874702486265216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855832.478689:0:11669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855832.478727:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486265216 00000100:00100000:0.0:1787855832.478733:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486265216 00000100:00100000:0.0:1787855832.478930:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787855832.478942:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:11669:x1874702486265216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855832.479248:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:11669:x1874702486265216:12345-0@lo:502:llog_process_th.0 Request processed in 308us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855832.479255:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787855832.483988:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73f44a50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787855832.484070:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1320f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2adc339-cccb-4166-8f83-87a1e9e399f1:11669:1874702486265216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787855832.484212:0:11669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787855832.484227:0:11669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855832.484230:0:11669:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787855832.484236:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787855832.484494:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787855832.484525:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787855832.484540:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d852 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855832.484554:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d852 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787855832.485900:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787855832.502601:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855832.504326:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855832.504378:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855832.504428:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464211968 00000100:00100000:0.0:1787855832.504440:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464211968 00000100:00100000:0.0:1787855832.504516:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464212224 00000100:00100000:0.0:1787855832.504520:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464212224 00000100:00100000:0.0:1787855832.504548:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 104 00000100:00100000:0.0:1787855832.504559:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1320f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464211968:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855832.504654:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1320f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464211968:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 96us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855832.504663:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 104 00000100:00100000:0.0:1787855832.504684:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 105 00000100:00100000:0.0:1787855832.504691:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1321e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464212224:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855832.504717:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1321e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464212224:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855832.504723:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 105 00000100:00080000:0.0:1787855832.504743:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855832.507293:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464212096 00000100:00100000:1.0:1787855832.507315:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464212096 00000100:00100000:1.0:1787855832.507469:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:1.0:1787855832.507483:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1322940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464212096:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855832.507593:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1322940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464212096:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 112us (5005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855832.507601:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00080000:0.0:1787855832.510982:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787855832.701038:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486265728:0@lo:400:kworker.0 00000100:00100000:0.0:1787855832.701137:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855832.701237:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787855832.701245:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486265600:0@lo:400:kworker.0 00000100:00100000:0.0:1787855832.701308:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855832.701347:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486265728 00000100:00100000:0.0:1787855832.701363:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486265728 00000100:00100000:0.0:1787855832.701433:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787855832.701445:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa095a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486265728:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787855832.701624:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787855832.701641:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486265600 00000100:00100000:2.0:1787855832.701645:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486265600 00000100:00100000:2.0:1787855832.701690:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787855832.701697:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7447c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486265600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855832.701757:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7447c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486265600:12345-0@lo:400:kworker.0 Request processed in 60us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855832.701765:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1787855832.701823:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855832.701853:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa096940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486265600:0@lo:400:kworker.0 00000100:00100000:1.0:1787855832.702074:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1320b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486265472:0@lo:400:kworker.0 00000100:00100000:1.0:1787855832.702107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855832.702144:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787855832.702151:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1320780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486265344:0@lo:400:kworker.0 00000100:00100000:1.0:1787855832.702185:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855832.702215:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486265472 00000100:00100000:1.0:1787855832.702219:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486265472 00000100:00100000:1.0:1787855832.702243:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486265344 00000100:00100000:1.0:1787855832.702245:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486265344 00000100:00100000:1.0:1787855832.702256:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787855832.702260:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486265472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855832.702295:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486265472:12345-0@lo:400:kworker.0 Request processed in 35us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855832.702300:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787855832.702310:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787855832.702314:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486265344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855832.702330:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486265344:12345-0@lo:400:kworker.0 Request processed in 17us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855832.702334:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787855832.702350:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1320780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486265344:0@lo:400:kworker.0 00000100:00100000:1.0:1787855832.702356:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1320b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486265472:0@lo:400:kworker.0 00000100:00080000:1.0:1787855832.702366:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855832.703258:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa095a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486265728:12345-0@lo:400:kworker.0 Request processed in 1809us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855832.703271:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787855832.703831:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73fa094000 x1874702486265728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855832.703843:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486265728:0@lo:400:kworker.0 00010000:00010000:3.0:1787855832.828094:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855833.212717:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486265856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787855833.212839:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855833.213021:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486265856 00000100:00100000:2.0:1787855833.213033:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486265856 00000100:00100000:2.0:1787855833.213098:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787855833.213117:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7446d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486265856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787855833.213176:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787855833.213240:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7446d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486265856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855833.213248:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1787855833.213617:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73f9df8f00 x1874702486265856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855833.213641:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486265856:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787855833.533911:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787855833.853257:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787855834.819817:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:3.0:1787855834.878282:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855835.900051:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855836.924045:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855837.308136:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486265984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787855837.308216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855837.308369:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486265984 00000100:00100000:3.0:1787855837.308377:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486265984 00000100:00100000:3.0:1787855837.308450:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787855837.308460:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486265984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787855837.308495:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855837.308544:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486265984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855837.308551:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787855837.308605:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1787855837.308611:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a73f763e940, transno 4294967300 00000100:00100000:3.0:1787855837.308626:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486265984:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787855837.308824:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787855837.607472:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855837.607513:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855837.607544:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855837.607593:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855837.607669:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464212480 00000100:00100000:2.0:1787855837.607680:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464212480 00000100:00100000:2.0:1787855837.607747:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464212736 00000100:00100000:2.0:1787855837.607751:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464212736 00000100:00100000:2.0:1787855837.607805:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 109 00000100:00100000:2.0:1787855837.607817:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2359:x1874702464212480:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855837.607904:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2359:x1874702464212480:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 78us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855837.607912:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 109 00000100:00100000:2.0:1787855837.607941:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 110 00000100:00100000:2.0:1787855837.607950:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7444f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2359:x1874702464212736:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855837.607973:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7444f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2359:x1874702464212736:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855837.607979:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 110 00000100:00100000:1.0:1787855837.609177:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464212352 00000100:00100000:1.0:1787855837.609187:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464212352 00000100:00100000:1.0:1787855837.609244:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 275 00000100:00100000:1.0:1787855837.609252:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2359:x1874702464212352:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855837.609304:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2359:x1874702464212352:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 52us (1844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855837.609311:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 275 00000100:00080000:0.0:1787855837.609438:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855837.609567:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464212608 00000100:00100000:3.0:1787855837.609572:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464212608 00000100:00100000:3.0:1787855837.609834:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:3.0:1787855837.609843:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7447840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2359:x1874702464212608:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855837.609883:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7447840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2359:x1874702464212608:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 42us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855837.609890:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00080000:0.0:1787855837.610163:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787855837.820257:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486266496:0@lo:400:kworker.0 00000100:00100000:3.0:1787855837.820332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855837.820401:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787855837.820407:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486266368:0@lo:400:kworker.0 00000100:00100000:3.0:1787855837.820430:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855837.820464:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486266496 00000100:00100000:3.0:1787855837.820471:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486266496 00000100:00100000:3.0:1787855837.820523:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486266368 00000100:00100000:3.0:1787855837.820527:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486266368 00000100:00100000:3.0:1787855837.820549:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787855837.820558:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486266496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855837.820608:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486266496:12345-0@lo:400:kworker.0 Request processed in 49us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855837.820615:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787855837.820630:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787855837.820636:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486266368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855837.820681:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486266368:12345-0@lo:400:kworker.0 Request processed in 45us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855837.820687:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787855837.820733:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486266368:0@lo:400:kworker.0 00000100:00100000:3.0:1787855837.820744:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486266496:0@lo:400:kworker.0 00000100:00100000:1.0:1787855837.820901:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486266240:0@lo:400:kworker.0 00000100:00100000:1.0:1787855837.820944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855837.820983:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787855837.820989:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486266112:0@lo:400:kworker.0 00000100:00100000:1.0:1787855837.821016:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855837.821037:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486266624:0@lo:400:kworker.0 00000100:00100000:1.0:1787855837.821061:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855837.821126:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486266240 00000100:00100000:3.0:1787855837.821131:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486266240 00000100:00100000:3.0:1787855837.821163:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787855837.821169:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486266240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855837.821205:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486266240:12345-0@lo:400:kworker.0 Request processed in 37us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855837.821211:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1787855837.821315:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855837.821350:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486266240:0@lo:400:kworker.0 00000100:00100000:2.0:1787855837.821993:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486266112 00000100:00100000:2.0:1787855837.822000:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486266112 00000100:00100000:2.0:1787855837.822052:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787855837.822060:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486266112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855837.822109:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486266112:12345-0@lo:400:kworker.0 Request processed in 50us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855837.822115:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787855837.822156:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486266624 00000100:00100000:2.0:1787855837.822160:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486266624 00000100:00100000:2.0:1787855837.822188:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787855837.822194:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486266624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855837.822234:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486266624:12345-0@lo:400:kworker.0 Request processed in 40us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855837.822240:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787855837.822545:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787855837.822569:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486266112:0@lo:400:kworker.0 00010000:00080000:0.0:1787855837.822601:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73f9dfb480 x1874702486266624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855837.822614:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486266624:0@lo:400:kworker.0 00010000:00010000:3.0:1787855837.948254:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855838.333605:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787855838.333633:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486266752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787855838.333713:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855838.334000:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486266752 00000100:00100000:3.0:1787855838.334009:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486266752 00000100:00100000:3.0:1787855838.334066:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787855838.334075:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486266752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787855838.334115:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855838.334292:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486266752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 217us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855838.334300:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1787855838.334703:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73f9dfa1c0 x1874702486266752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855838.334724:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486266752:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787855838.973154:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855839.996088:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855841.022067:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855842.045183:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855842.430085:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787855842.430112:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486266880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787855842.430185:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855842.430323:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486266880 00000100:00100000:1.0:1787855842.430331:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486266880 00000100:00080000:3.0:1787855842.436164:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787855842.436600:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787855842.436619:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486266880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787855842.436662:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787855842.436752:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486266880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (6567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855842.436760:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787855842.437087:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486266880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787855842.730541:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855842.730583:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855842.730627:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855842.730749:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464212992 00000100:00100000:0.0:1787855842.730765:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464212992 00000100:00100000:0.0:1787855842.730871:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464213248 00000100:00100000:0.0:1787855842.730875:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464213248 00000100:00100000:0.0:1787855842.730902:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 114 00000100:00100000:0.0:1787855842.730913:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2360:x1874702464212992:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855842.730999:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2360:x1874702464212992:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 88us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855842.731006:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 114 00000100:00100000:0.0:1787855842.731023:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 115 00000100:00100000:0.0:1787855842.731029:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2360:x1874702464213248:12345-192.168.201.38@tcp:400:kworker.0 00000100:00080000:3.0:1787855842.731157:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855842.731376:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855842.731858:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464213120 00000100:00100000:3.0:1787855842.731864:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464213120 00000100:00100000:3.0:1787855842.731912:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:3.0:1787855842.731920:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2360:x1874702464213120:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855842.731978:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2360:x1874702464213120:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 58us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855842.731984:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:0.0:1787855842.732217:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2360:x1874702464213248:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 1186us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855842.732226:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 115 00000100:00080000:2.0:1787855842.732485:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787855842.733751:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464212864 00000100:00100000:1.0:1787855842.733762:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464212864 00000100:00100000:1.0:1787855842.733952:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 277 00000100:00100000:1.0:1787855842.733963:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2360:x1874702464212864:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855842.734052:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2360:x1874702464212864:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 84us (3416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855842.734059:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 277 00000100:00100000:1.0:1787855842.940448:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787855842.940541:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787855842.940552:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7446580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486267136:0@lo:400:kworker.0 00000100:00100000:3.0:1787855842.940554:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486267392:0@lo:400:kworker.0 00000100:00100000:1.0:1787855842.940597:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486267008:0@lo:400:kworker.0 00000100:00100000:3.0:1787855842.940660:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855842.940722:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486267392 00000100:00100000:3.0:1787855842.940730:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486267392 00000100:00100000:3.0:1787855842.940812:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787855842.940835:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486267392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855842.940900:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486267392:12345-0@lo:400:kworker.0 Request processed in 67us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855842.940908:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1787855842.940931:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855842.941112:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7445a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486267264:0@lo:400:kworker.0 00000100:00100000:0.0:1787855842.941142:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855842.941191:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486267264 00000100:00100000:0.0:1787855842.941196:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486267264 00000100:00100000:0.0:1787855842.941226:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787855842.941232:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7444780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486267264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855842.941264:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7444780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486267264:12345-0@lo:400:kworker.0 Request processed in 32us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855842.941269:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787855842.941302:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7445a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486267264:0@lo:400:kworker.0 00000100:00100000:3.0:1787855842.941370:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486267520:0@lo:400:kworker.0 00000100:00100000:3.0:1787855842.941397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855842.941434:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486267392:0@lo:400:kworker.0 00000100:00080000:3.0:1787855842.941451:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855842.941613:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486267520 00000100:00100000:0.0:1787855842.941618:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486267520 00000100:00100000:0.0:1787855842.941660:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787855842.941681:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486267520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855842.941720:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486267520:12345-0@lo:400:kworker.0 Request processed in 41us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855842.941727:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1787855842.942948:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787855842.942991:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73e7447480 x1874702486267520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855842.943023:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486267520:0@lo:400:kworker.0 00000100:00100000:2.0:1787855842.943174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855842.944216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855842.944534:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486267008 00000100:00100000:0.0:1787855842.944542:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486267008 00000100:00100000:0.0:1787855842.944595:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787855842.944604:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486267008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855842.944669:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486267008:12345-0@lo:400:kworker.0 Request processed in 65us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855842.944676:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787855842.944814:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486267136 00000100:00100000:3.0:1787855842.944819:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486267136 00000100:00100000:3.0:1787855842.944867:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787855842.944875:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486267136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855842.944926:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486267136:12345-0@lo:400:kworker.0 Request processed in 52us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855842.944932:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787855842.945047:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7446580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486267136:0@lo:400:kworker.0 00000100:00100000:1.0:1787855842.945442:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486267008:0@lo:400:kworker.0 00010000:00010000:1.0:1787855843.070079:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855843.452458:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787855843.452484:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486267648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787855843.452554:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855843.452818:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486267648 00000100:00100000:3.0:1787855843.452826:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486267648 00000100:00100000:3.0:1787855843.452926:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787855843.452936:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486267648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787855843.452973:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855843.453027:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486267648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855843.453043:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787855843.453110:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73f9df8b40 x1874702486267648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855843.453130:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486267648:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787855843.772629:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787855844.092632:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855845.117329:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855846.142364:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855847.163961:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855847.548398:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787855847.548421:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486267776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787855847.548492:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855847.549010:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486267776 00000100:00100000:1.0:1787855847.549018:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486267776 00000100:00100000:1.0:1787855847.549091:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787855847.549101:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa096940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486267776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787855847.549134:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787855847.549363:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787855847.549470:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa096940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486267776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 371us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855847.549478:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787855847.549620:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486267776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855847.847213:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855847.847293:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855847.847730:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464213376 00000100:00100000:1.0:1787855847.847746:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464213376 00000100:00100000:1.0:1787855847.847879:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 279 00000100:00100000:1.0:1787855847.847890:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c93f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2358:x1874702464213376:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855847.847993:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c93f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2358:x1874702464213376:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 104us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855847.848000:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 279 00000100:00100000:0.0:1787855847.849731:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464213504 00000100:00100000:0.0:1787855847.849741:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464213504 00000100:00080000:3.0:1787855847.849828:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855847.849879:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00100000:0.0:1787855847.849891:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2358:x1874702464213504:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855847.849970:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2358:x1874702464213504:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 82us (2771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855847.849977:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00100000:3.0:1787855847.861461:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855847.861545:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855847.862211:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464213632 00000100:00100000:1.0:1787855847.862221:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464213632 00000100:00100000:1.0:1787855847.862304:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:1.0:1787855847.862316:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2356:x1874702464213632:12345-192.168.201.38@tcp:9:kworker.0 00000020:00000080:1.0:1787855847.862355:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d78e 00000100:00080000:1.0:1787855847.862365:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9a72c1327000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787855847.862404:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787855847.862673:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+2:2356:x1874702464213632:12345-192.168.201.38@tcp:9:kworker.0 Request processed in 357us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855847.862681:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00010000:00010000:1.0:1787855847.862701:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855847.863464:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464213760 00000100:00100000:0.0:1787855847.863471:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464213760 00000100:00100000:0.0:1787855847.863517:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:0.0:1787855847.863532:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464213760:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855847.863587:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464213760:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 56us (2135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855847.863594:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00080000:3.0:1787855847.863740:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787855847.863746:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787855848.063076:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7445e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486268288:0@lo:400:kworker.0 00000100:00100000:2.0:1787855848.063080:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7445680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486268160:0@lo:400:kworker.0 00000100:00100000:1.0:1787855848.063146:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7446580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486267904:0@lo:400:kworker.0 00000100:00100000:3.0:1787855848.063207:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7445a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486268032:0@lo:400:kworker.0 00000100:00100000:2.0:1787855848.071438:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855848.071562:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486268160 00000100:00100000:2.0:1787855848.071571:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486268160 00000100:00100000:2.0:1787855848.071633:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787855848.071645:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486268160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855848.071698:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486268160:12345-0@lo:400:kworker.0 Request processed in 57us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855848.071705:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787855848.071748:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7445680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486268160:0@lo:400:kworker.0 00000100:00080000:2.0:1787855848.072003:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855848.077810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855848.077977:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7444b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486268416:0@lo:400:kworker.0 00000100:00100000:1.0:1787855848.078012:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855848.078083:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486268416 00000100:00100000:1.0:1787855848.078090:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486268416 00000100:00100000:1.0:1787855848.078144:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787855848.078153:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486268416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855848.078206:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486268416:12345-0@lo:400:kworker.0 Request processed in 54us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855848.078213:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787855848.078253:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73e7444b40 x1874702486268416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855848.078266:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7444b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486268416:0@lo:400:kworker.0 00000100:00080000:1.0:1787855848.078302:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787855848.080238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855848.082482:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486268032 00000100:00100000:1.0:1787855848.082495:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486268032 00000100:00100000:1.0:1787855848.082561:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787855848.082572:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486268032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855848.082653:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486268032:12345-0@lo:400:kworker.0 Request processed in 83us (2420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855848.082660:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787855848.082912:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7445a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486268032:0@lo:400:kworker.0 00000100:00100000:0.0:1787855848.083834:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855848.084189:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486268288 00000100:00100000:3.0:1787855848.084195:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486268288 00000100:00100000:3.0:1787855848.084252:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787855848.084260:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7446940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486268288:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787855848.085041:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855848.087340:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486267904 00000100:00100000:2.0:1787855848.087354:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486267904 00000100:00100000:2.0:1787855848.087426:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787855848.087438:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486267904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855848.087540:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486267904:12345-0@lo:400:kworker.0 Request processed in 104us (9861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855848.087547:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787855848.087571:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7446580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486267904:0@lo:400:kworker.0 00000100:00100000:0.0:1787855848.095016:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7445e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486268288:0@lo:400:kworker.0 00000100:00100000:3.0:1787855848.095269:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7446940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486268288:12345-0@lo:400:kworker.0 Request processed in 11008us (11434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855848.095282:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00010000:1.0:1787855848.187934:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855848.572374:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486268544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787855848.572445:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855848.572611:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486268544 00000100:00100000:3.0:1787855848.572619:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486268544 00000100:00100000:3.0:1787855848.572672:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787855848.572681:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7445e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486268544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787855848.572715:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855848.572799:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7445e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486268544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855848.572807:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1787855848.573075:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73f9df8b40 x1874702486268544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855848.573093:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486268544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787855849.212116:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787855850.209317:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6933b672-fa85-4aae-9dc8-092c3f355bbf 00000020:00000080:3.0:1787855850.209326:0:6703:0:(genops.c:885:class_export_put()) final put ffff9a72c1321800/6933b672-fa85-4aae-9dc8-092c3f355bbf 00000020:00000080:3.0:1787855850.209353:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a72c1321800/6933b672-fa85-4aae-9dc8-092c3f355bbf for lustre-OST0000 00000020:00000080:3.0:1787855850.209397:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a72c1327000 for lustre-OST0000 00010000:00010000:3.0:1787855850.238199:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855851.259947:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855852.284771:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855852.691207:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787855852.691242:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486268672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787855852.691337:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855852.696686:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486268672 00000100:00100000:3.0:1787855852.696729:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486268672 00000100:00080000:1.0:1787855852.697025:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787855852.697623:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787855852.697638:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486268672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787855852.697766:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855852.698081:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486268672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 447us (6743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855852.698091:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787855852.711317:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486268672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787855852.970842:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855852.970893:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855852.970922:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855852.970970:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464214144 00000100:00100000:0.0:1787855852.970983:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464214144 00000100:00100000:0.0:1787855852.971287:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464214016 00000100:00100000:0.0:1787855852.971291:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464214016 00000100:00100000:0.0:1787855852.971319:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:0.0:1787855852.971331:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7446580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2358:x1874702464214144:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855852.971428:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7446580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2358:x1874702464214144:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 98us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855852.971457:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:0.0:1787855852.971477:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 125 00000100:00100000:0.0:1787855852.971484:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2358:x1874702464214016:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855852.971529:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2358:x1874702464214016:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 45us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855852.971536:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 125 00000100:00100000:3.0:1787855852.971837:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464213888 00000100:00100000:3.0:1787855852.971843:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464213888 00000100:00100000:3.0:1787855852.971882:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 281 00000100:00100000:3.0:1787855852.971890:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2358:x1874702464213888:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855852.971919:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7166450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2358:x1874702464213888:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 31us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855852.971926:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 281 00000100:00080000:1.0:1787855852.973761:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855853.185954:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486268800:0@lo:400:kworker.0 00000100:00100000:3.0:1787855853.186076:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855853.186138:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486269312:0@lo:400:kworker.0 00000100:00100000:3.0:1787855853.186167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855853.186201:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787855853.186208:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486269184:0@lo:400:kworker.0 00000100:00100000:3.0:1787855853.186248:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855853.186289:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486268800 00000100:00100000:3.0:1787855853.186298:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486268800 00000100:00100000:3.0:1787855853.186349:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787855853.186359:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486268800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855853.186415:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486268800:12345-0@lo:400:kworker.0 Request processed in 57us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855853.186446:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787855853.186838:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486269312 00000100:00100000:3.0:1787855853.186843:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486269312 00000100:00100000:3.0:1787855853.186886:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787855853.186890:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486268928:0@lo:400:kworker.0 00000100:00100000:3.0:1787855853.186894:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486269312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855853.186924:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855853.186927:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486269312:12345-0@lo:400:kworker.0 Request processed in 35us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855853.186933:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787855853.186943:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486268928 00000100:00100000:1.0:1787855853.186945:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486269440:0@lo:400:kworker.0 00000100:00100000:3.0:1787855853.186946:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486268928 00000100:00100000:1.0:1787855853.186969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855853.186978:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787855853.186984:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486268928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855853.186989:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787855853.186996:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486269056:0@lo:400:kworker.0 00000100:00100000:1.0:1787855853.189084:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855853.189167:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486268928:0@lo:400:kworker.0 00000100:00100000:1.0:1787855853.189240:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486269184 00000100:00100000:1.0:1787855853.189247:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486269184 00000100:00100000:1.0:1787855853.189314:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486269440 00000100:00100000:1.0:1787855853.189317:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486269440 00000100:00100000:1.0:1787855853.189345:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787855853.189354:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486269184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855853.189408:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486269184:12345-0@lo:400:kworker.0 Request processed in 56us (3160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855853.189417:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787855853.189442:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787855853.189449:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1320b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486269440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855853.189484:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1320b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486269440:12345-0@lo:400:kworker.0 Request processed in 36us (2514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855853.189491:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1787855853.189508:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787855853.189514:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855853.189526:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486269056 00000100:00100000:1.0:1787855853.189529:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486269056 00000100:00100000:1.0:1787855853.189556:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787855853.189562:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1320780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486269056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855853.189589:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1320780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486269056:12345-0@lo:400:kworker.0 Request processed in 27us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855853.189595:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787855853.189635:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486269056:0@lo:400:kworker.0 00010000:00080000:1.0:1787855853.189651:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73f9dbd680 x1874702486269440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855869 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855853.189678:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486269440:0@lo:400:kworker.0 00000100:00080000:1.0:1787855853.189698:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855853.190231:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486269184:0@lo:400:kworker.0 00000100:00100000:1.0:1787855853.190246:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486268800:0@lo:400:kworker.0 00000100:00100000:1.0:1787855853.190258:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486269312:0@lo:400:kworker.0 00000100:00100000:3.0:1787855853.195247:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486268928:12345-0@lo:400:kworker.0 Request processed in 8235us (8294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855853.195266:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00010000:3.0:1787855853.313702:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855853.694121:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486269568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787855853.694236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855853.694397:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486269568 00000100:00100000:2.0:1787855853.694425:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486269568 00000100:00100000:2.0:1787855853.694502:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787855853.694514:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486269568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787855853.694564:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787855853.705105:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486269568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10575us (10862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855853.705126:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1787855853.709868:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73e74443c0 x1874702486269568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855853.709905:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486269568:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787855854.019071:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787855854.339077:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855855.360550:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787855856.283332:0:11837:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:37:34 (1787855854) 00010000:00010000:0.0:1787855856.393029:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855857.404324:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855857.788127:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486269696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787855857.788203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855857.788636:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486269696 00000100:00100000:2.0:1787855857.788645:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486269696 00000100:00100000:2.0:1787855857.788723:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787855857.788735:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486269696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787855857.788769:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787855857.788845:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486269696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855857.788852:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1787855857.788930:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787855857.789122:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486269696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787855858.108618:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855858.108671:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855858.108717:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855858.108888:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464214272 00000100:00100000:0.0:1787855858.108898:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464214272 00000100:00100000:0.0:1787855858.108962:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 283 00000100:00100000:0.0:1787855858.108972:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2357:x1874702464214272:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855858.109044:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7165850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2357:x1874702464214272:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 73us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855858.109052:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 283 00000100:00100000:2.0:1787855858.109845:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464214528 00000100:00100000:2.0:1787855858.109853:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464214528 00000100:00100000:2.0:1787855858.109896:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464214400 00000100:00100000:2.0:1787855858.109899:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464214400 00000100:00100000:2.0:1787855858.109921:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 129 00000100:00100000:2.0:1787855858.109928:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464214528:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855858.109989:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464214528:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 60us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855858.109996:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 129 00000100:00100000:2.0:1787855858.110013:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 130 00000100:00100000:2.0:1787855858.110019:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464214400:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855858.110064:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464214400:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 45us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855858.110071:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 130 00000100:00080000:1.0:1787855858.111818:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855858.300732:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486269824:0@lo:400:kworker.0 00000100:00100000:1.0:1787855858.300840:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855858.301093:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486270336:0@lo:400:kworker.0 00000100:00100000:1.0:1787855858.301124:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855858.301153:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787855858.301159:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486270208:0@lo:400:kworker.0 00000100:00100000:1.0:1787855858.301185:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855858.301217:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486270208 00000100:00100000:1.0:1787855858.301224:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486270208 00000100:00100000:1.0:1787855858.301271:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787855858.301291:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486270208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855858.301343:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486270208:12345-0@lo:400:kworker.0 Request processed in 64us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855858.301350:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787855858.301405:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486270208:0@lo:400:kworker.0 00000100:00100000:0.0:1787855858.301629:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486269952:0@lo:400:kworker.0 00000100:00100000:0.0:1787855858.301678:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855858.301708:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486270464:0@lo:400:kworker.0 00000100:00100000:0.0:1787855858.301728:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855858.301742:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787855858.301748:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486270080:0@lo:400:kworker.0 00000100:00100000:0.0:1787855858.301764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855858.301813:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486270336 00000100:00100000:0.0:1787855858.301817:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486270336 00000100:00100000:0.0:1787855858.301851:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486269952 00000100:00100000:0.0:1787855858.301854:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486269952 00000100:00100000:0.0:1787855858.301864:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486270080 00000100:00100000:0.0:1787855858.301867:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486270080 00000100:00100000:0.0:1787855858.301881:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787855858.301887:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486270336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855858.301923:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486270336:12345-0@lo:400:kworker.0 Request processed in 36us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855858.301928:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787855858.301941:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787855858.301946:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7445a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486269952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855858.301983:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7445a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486269952:12345-0@lo:400:kworker.0 Request processed in 37us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855858.301988:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787855858.302000:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787855858.302005:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7445680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486270080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855858.302028:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7445680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486270080:12345-0@lo:400:kworker.0 Request processed in 23us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855858.302043:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787855858.302075:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486270080:0@lo:400:kworker.0 00000100:00100000:1.0:1787855858.302173:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486270464 00000100:00100000:1.0:1787855858.302178:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486270464 00000100:00100000:1.0:1787855858.302207:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787855858.302214:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7444b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486270464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855858.302247:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7444b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486270464:12345-0@lo:400:kworker.0 Request processed in 33us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855858.302252:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1787855858.302281:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787855858.302286:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855858.302303:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486270336:0@lo:400:kworker.0 00000100:00100000:0.0:1787855858.302366:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486269952:0@lo:400:kworker.0 00010000:00080000:0.0:1787855858.302383:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a7400694000 x1874702486270464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787855874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855858.302394:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486270464:0@lo:400:kworker.0 00000100:00100000:2.0:1787855858.307815:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486269824 00000100:00100000:2.0:1787855858.307831:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486269824 00000100:00100000:2.0:1787855858.307905:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787855858.307916:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486269824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855858.309151:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7165450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486269824:12345-0@lo:400:kworker.0 Request processed in 1232us (8306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855858.309164:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787855858.310356:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486269824:0@lo:400:kworker.0 00010000:00010000:0.0:1787855858.428632:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855858.812618:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787855858.834487:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486270592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787855858.834592:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855858.836913:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486270592 00000100:00100000:2.0:1787855858.836927:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486270592 00000100:00100000:2.0:1787855858.836999:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787855858.837008:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486270592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787855858.837054:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787855858.837154:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486270592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (2562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855858.837161:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1787855858.840193:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73e7444000 x1874702486270592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787855874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855858.840221:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486270592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787855859.033644:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855859.034261:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464214656 00000100:00100000:2.0:1787855859.034272:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464214656 00000100:00100000:2.0:1787855859.034337:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:2.0:1787855859.034347:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:10227:x1874702464214656:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787855859.034368:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855859.034392:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046e00/0x516929ca3366d859 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616afa expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.034495:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d860 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.034510:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.034524:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855859.034739:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787855859.034744:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787855859.034875:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d860 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.034900:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046e00/0x516929ca3366d859 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616afa expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.034915:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d860 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616afa expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.034922:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093700) 00010000:00010000:2.0:1787855859.034925:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787855859.034928:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402047800, rc 0) 00000100:00100000:2.0:1787855859.035008:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:10227:x1874702464214656:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 662us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855859.035015:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:1.0:1787855859.045105:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855859.045231:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464214784 00000100:00100000:2.0:1787855859.045243:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464214784 00000100:00100000:2.0:1787855859.045371:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:2.0:1787855859.045382:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:10228:x1874702464214784:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787855859.045408:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855859.045435:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046e00/0x516929ca3366d867 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b01 expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.045515:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d86e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.045531:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d86e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.045543:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d86e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.045559:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d875 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.045577:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.045584:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.046508:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046200/0x516929ca3366d87c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.046520:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046200/0x516929ca3366d87c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.046529:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046200/0x516929ca3366d87c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855859.047000:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787855859.047005:0:9629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787855859.047092:0:9629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046200/0x516929ca3366d87c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.047107:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d86e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.047114:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d86e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.047120:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d86e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.047127:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402047400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855859.047131:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d86e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.047140:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d86e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.047156:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093700) 00010000:00010000:2.0:1787855859.047159:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855859.047165:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d86e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.047172:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d86e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.047186:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d875 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.051377:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d875 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.051387:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d875 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.051394:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402046000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855859.051400:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d875 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.051410:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d875 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.051431:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a73c7093d00) 00010000:00010000:2.0:1787855859.051434:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855859.051439:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d875 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.051447:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d875 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.051526:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046e00/0x516929ca3366d867 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b01 expref: 8 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.051543:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046200/0x516929ca3366d87c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b01 expref: 7 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855859.051551:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a73c7093c00) 00010000:00010000:2.0:1787855859.051553:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787855859.051576:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402046200, rc 0) 00000100:00100000:2.0:1787855859.051704:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:10228:x1874702464214784:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 6321us (6611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855859.052652:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:3.0:1787855859.057392:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855859.062401:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464215040 00000100:00100000:2.0:1787855859.062420:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464215040 00000100:00100000:3.0:1787855859.064961:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:3.0:1787855859.064978:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400697c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:10228:x1874702464215040:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787855859.065007:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855859.065038:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d883 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b08 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.065167:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d88a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.065184:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d88a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.065198:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d88a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.073225:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d891 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.073249:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d891 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.073261:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d891 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.073808:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229c00/0x516929ca3366d898 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.073818:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229c00/0x516929ca3366d898 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.073826:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229c00/0x516929ca3366d898 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855859.073838:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787855859.081316:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d88a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.081335:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d88a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.081356:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d88a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.081362:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855859.081367:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d88a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.081374:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d88a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.083624:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a73c7093c00) 00010000:00010000:3.0:1787855859.083629:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855859.083637:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d88a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.083645:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d88a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.083664:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d891 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.083671:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d891 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.083677:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d891 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.083682:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855859.083686:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d891 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.083712:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d891 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.083719:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a73d40ac500) 00010000:00010000:3.0:1787855859.083722:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855859.083725:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d891 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.083731:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d891 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.088419:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d883 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b08 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.088445:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229c00/0x516929ca3366d898 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b08 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855859.088455:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a73d40ac700) 00010000:00010000:3.0:1787855859.088458:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855859.088461:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229c00, rc 0) 00000100:00100000:3.0:1787855859.089832:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400697c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:10228:x1874702464215040:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 24851us (32448us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787855859.089843:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:0.0:1787855859.101971:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855859.105806:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464215168 00000100:00100000:3.0:1787855859.105830:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464215168 00000100:00100000:2.0:1787855859.105975:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:2.0:1787855859.106011:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:10228:x1874702464215168:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787855859.106135:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:10228:x1874702464215168:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 Request processed in 136us (4174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855859.106144:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00000040:00080000:0.0:1787855859.132734:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787855859.451922:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855860.497905:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787855860.533312:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:2.0:1787855861.503465:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855862.070252:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855862.070412:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464215296 00000100:00100000:3.0:1787855862.070424:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464215296 00000100:00100000:3.0:1787855862.070666:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:3.0:1787855862.070680:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:10271:x1874702464215296:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855862.070873:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855862.070900:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d8a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b0f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.070985:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d8ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071003:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d8ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071016:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d8ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071033:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071041:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071048:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071331:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d8ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071339:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d8ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071347:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d8ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071363:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855862.071368:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d8ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071377:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d8ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071392:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093700) 00010000:00010000:3.0:1787855862.071396:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855862.071401:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d8ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071408:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d8ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071421:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071426:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071433:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071439:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855862.071441:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071447:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071466:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a73d40ac900) 00010000:00010000:3.0:1787855862.071469:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855862.071472:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071479:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071529:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d8a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b0f expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071541:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093700) 00010000:00010000:3.0:1787855862.071544:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855862.071548:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d8a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b0f expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.071557:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229000, rc 0) 00000100:00100000:3.0:1787855862.071938:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:10271:x1874702464215296:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1260us (1700us total) trans 0 rc 301/301 00000100:00100000:3.0:1787855862.071948:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00080000:1.0:1787855862.072029:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855862.080197:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855862.081266:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464215552 00000100:00100000:1.0:1787855862.081281:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464215552 00000100:00100000:1.0:1787855862.081358:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:1.0:1787855862.081369:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400695680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:10271:x1874702464215552:12345-192.168.201.38@tcp:36:lfs.0 00010000:00010000:1.0:1787855862.081445:0:9629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855862.081478:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d860 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616afa expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.081498:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093700) 00010000:00010000:1.0:1787855862.081522:0:9629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787855862.082225:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d8bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.082244:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d8bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.082262:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d8bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.082276:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d8c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.082283:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.082290:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855862.087752:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787855862.087808:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d8bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.087823:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d8bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.087832:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d8bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.087839:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855862.087844:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d8bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.087855:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d8bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.087877:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:1.0:1787855862.087881:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855862.087899:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d8bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.087907:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d8bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787855862.087930:0:9629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001918b9f2 reply state 0000000071e243f1 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855862.087941:0:9629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787855862.088087:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400695680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:10271:x1874702464215552:12345-192.168.201.38@tcp:36:lfs.0 Request processed in 6713us (7898us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787855862.088097:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 37 00010000:00010000:1.0:1787855862.090810:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d8c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.090832:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d8c2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.090841:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d8c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.090849:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fea00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855862.090855:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d8c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.090864:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d8c2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.090885:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a73c8d1d500) 00010000:00010000:1.0:1787855862.090888:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855862.090894:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d8c2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.090908:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366d8c2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855862.189735:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855862.189845:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464215680 00000100:00100000:2.0:1787855862.189859:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464215680 00000100:00100000:2.0:1787855862.189979:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:2.0:1787855862.189992:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400695e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:10279:x1874702464215680:12345-192.168.201.38@tcp:101:lctl.0 00010000:00010000:2.0:1787855862.190027:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855862.190057:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d8c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b16 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.190158:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046c00/0x516929ca3366d8d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.190176:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046c00/0x516929ca3366d8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.190193:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046c00/0x516929ca3366d8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855862.190297:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787855862.190302:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787855862.190362:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046c00/0x516929ca3366d8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.190395:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d8c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b16 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.190416:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046c00/0x516929ca3366d8d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b16 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.190426:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:2.0:1787855862.190430:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787855862.190434:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402046c00, rc 0) 00000100:00100000:2.0:1787855862.190520:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400695e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:10279:x1874702464215680:12345-192.168.201.38@tcp:101:lctl.0 Request processed in 531us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855862.190528:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:3.0:1787855862.273760:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855862.273986:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464215808 00000100:00100000:2.0:1787855862.273999:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464215808 00000100:00100000:2.0:1787855862.274139:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:2.0:1787855862.274153:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400696580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:10285:x1874702464215808:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1787855862.274179:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855862.274206:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d8d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b1d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.275618:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d8de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.275668:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d8de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.275749:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d8de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.275771:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d8e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.275795:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.275803:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.275940:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046e00/0x516929ca3366d8ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.275949:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046e00/0x516929ca3366d8ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.275957:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046e00/0x516929ca3366d8ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855862.275994:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787855862.275998:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787855862.276051:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046e00/0x516929ca3366d8ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276066:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d8de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276084:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d8de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276091:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d8de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276098:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402046000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855862.276104:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d8de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276113:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d8de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276127:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:2.0:1787855862.276130:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855862.276135:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d8de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276143:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d8de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276157:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d8e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276164:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d8e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276170:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276175:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402047800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855862.276183:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d8e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276190:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d8e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276197:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a73c7093d00) 00010000:00010000:2.0:1787855862.276200:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855862.276203:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d8e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276209:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d8e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276249:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366d8d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b1d expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276264:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046e00/0x516929ca3366d8ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b1d expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.276272:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:2.0:1787855862.276275:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787855862.276277:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402046e00, rc 0) 00000100:00100000:2.0:1787855862.276364:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400696580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+10:10285:x1874702464215808:12345-192.168.201.38@tcp:101:bash.0 Request processed in 2214us (2685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855862.276373:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:0.0:1787855862.288904:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855862.292020:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464216064 00000100:00100000:3.0:1787855862.292040:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464216064 00000100:00100000:3.0:1787855862.292186:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:3.0:1787855862.292200:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+10:10285:x1874702464216064:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1787855862.292248:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855862.292276:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d8f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b24 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.292468:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.292487:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.292502:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.292531:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d901 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.292539:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.292547:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787855862.294413:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787855862.294654:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366d908 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.294673:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366d908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.296004:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366d908 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.296092:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.296101:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.296110:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.296117:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855862.296122:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.296132:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.296148:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:3.0:1787855862.296151:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855862.296157:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.296164:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d8fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787855862.296183:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4486ebe reply state 000000003ff81cdb transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855862.296194:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787855862.296246:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d8f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b24 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.296275:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366d908 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b24 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.296284:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73d40ac500) 00010000:00010000:3.0:1787855862.296287:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787855862.296290:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228e00, rc 0) 00000100:00100000:3.0:1787855862.296383:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:10285:x1874702464216064:12345-192.168.201.38@tcp:101:bash.0 Request processed in 4186us (7495us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787855862.296394:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:2.0:1787855862.302973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00010000:1.0:1787855862.303078:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.303093:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d901 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.303103:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d901 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.303110:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855862.303116:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d901 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.303126:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d901 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.303148:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73d40ac900) 00010000:00010000:1.0:1787855862.303152:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855862.303157:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d901 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.303164:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366d901 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855862.303259:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464216192 00000100:00100000:3.0:1787855862.303270:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464216192 00000100:00100000:3.0:1787855862.303314:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:3.0:1787855862.303324:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1874702464216192:12345-192.168.201.38@tcp:8:bash.0 00010000:00080000:3.0:1787855862.303367:0:6679:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp t0 exp 0000000000000000 cur 353 last 0 00000020:00000080:3.0:1787855862.303404:0:6679:0:(genops.c:1385:class_connect()) connect: client 6933b672-fa85-4aae-9dc8-092c3f355bbf, cookie 0x516929ca3366d916 00002000:00100000:3.0:1787855862.303419:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6933b672-fa85-4aae-9dc8-092c3f355bbf/ffff9a73d22ec000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787855862.303462:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787855862.303953:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787855862.303990:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9a73d22ea000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787855862.304718:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2356:x1874702464216192:12345-192.168.201.38@tcp:8:bash.0 Request processed in 1388us (1753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855862.304729:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:0.0:1787855862.312195:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855862.312371:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464216320 00000100:00100000:1.0:1787855862.312385:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464216320 00000100:00100000:1.0:1787855862.312497:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:1.0:1787855862.312531:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:0:x1874702464216320:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1787855862.312585:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855862.312619:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e394c16b/0x516929ca3366d91d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b2b expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787855862.312663:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787855862.312686:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1787855862.312692:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787855862.312704:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e394c16b/0x516929ca3366d91d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b2b expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.312730:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e394c16b/0x516929ca3366d91d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b2b expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.312747:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe800, rc 0) 00000100:00100000:1.0:1787855862.312877:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:0:x1874702464216320:12345-192.168.201.38@tcp:101:bash.0 Request processed in 369us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855862.312884:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00080000:2.0:1787855862.312986:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787855862.320900:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855862.323823:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464216448 00000100:00100000:2.0:1787855862.323842:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464216448 00000100:00100000:2.0:1787855862.325618:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:2.0:1787855862.325645:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:10285:x1874702464216448:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1787855862.325670:0:8077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855862.325770:0:8077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b32 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.325825:0:8077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e394c16b/0x516929ca3366d91d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b2b expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.325836:0:8077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855862.325841:0:8077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855862.325848:0:8077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b32 expref: 8 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.325894:0:8077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e394c16b/0x516929ca3366d91d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b2b expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.325911:0:8077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e394c16b/0x516929ca3366d91d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b2b expref: 8 pid: 6681 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855862.325928:0:8077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7421e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8077:1874702486270720:192.168.201.38@tcp:104: 00000100:00100000:2.0:1787855862.326067:0:8077:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855862.338156:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855862.338256:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464216576 00000100:00100000:3.0:1787855862.338268:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464216576 00010000:00010000:3.0:1787855862.338336:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e394c16b/0x516929ca3366d91d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b2b expref: 9 pid: 6681 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855862.338385:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:3.0:1787855862.338396:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7423840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2358:x1874702464216576:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787855862.338414:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855862.338445:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e394c16b/0x516929ca3366d91d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b2b expref: 9 pid: 6681 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.338462:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e394c16b/0x516929ca3366d91d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b2b expref: 9 pid: 6681 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.338496:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855862.338501:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855862.338524:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b32 expref: 9 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.338536:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b32 expref: 9 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.338581:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b32 expref: 9 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855862.338599:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006961c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1874702486270848:192.168.201.38@tcp:105: 00000100:00100000:3.0:1787855862.338851:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d08aaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787855862.342417:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006961c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1874702486270848:192.168.201.38@tcp:105: 00010000:00010000:3.0:1787855862.342466:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855862.342592:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7423840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2358:x1874702464216576:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 4195us (4448us total) trans 0 rc 0/0 00010000:00010000:1.0:1787855862.342614:0:8077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e394c16b/0x516929ca3366d91d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b2b expref: 9 pid: 6681 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855862.342615:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:1.0:1787855862.342636:0:8077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7421e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8077:1874702486270720:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855862.342670:0:8077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b32 expref: 7 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.342694:0:8077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402047400, rc 0) 00000100:00100000:1.0:1787855862.342717:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:10285:x1874702464216448:12345-192.168.201.38@tcp:101:bash.0 Request processed in 17088us (21834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855862.342723:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:0.0:1787855862.345860:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855862.345975:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464216832 00000100:00100000:3.0:1787855862.345987:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464216832 00000100:00100000:3.0:1787855862.346095:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:3.0:1787855862.346107:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+12:10285:x1874702464216832:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:3.0:1787855862.346540:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:10285:x1874702464216832:12345-192.168.201.38@tcp:35:bash.0 Request processed in 434us (695us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787855862.346549:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:2.0:1787855862.419074:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855862.419192:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464217088 00000100:00100000:1.0:1787855862.419205:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464217088 00000100:00100000:1.0:1787855862.419303:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:1.0:1787855862.419315:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7421680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:10295:x1874702464217088:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787855862.419346:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855862.419373:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d92b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b39 expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855862.419529:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787855862.420179:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d92b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b39 expref: 15 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.420199:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:1.0:1787855862.420203:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787855862.420209:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366d92b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b39 expref: 15 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.420226:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe800, rc 0) 00000100:00100000:1.0:1787855862.420341:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7421680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:10295:x1874702464217088:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1028us (1279us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1787855862.420351:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:0.0:1787855862.423578:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855862.424384:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464217344 00000100:00100000:2.0:1787855862.424398:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464217344 00000100:00100000:2.0:1787855862.424486:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:2.0:1787855862.424497:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:10295:x1874702464217344:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:2.0:1787855862.425129:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:10295:x1874702464217344:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 631us (1562us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787855862.425140:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:2.0:1787855862.487573:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855862.488537:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464217472 00000100:00100000:3.0:1787855862.488552:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464217472 00000100:00100000:3.0:1787855862.488634:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:3.0:1787855862.488645:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7421e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:10301:x1874702464217472:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855862.488746:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855862.488811:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d939 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b40 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.489178:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d940 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.489197:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.489211:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855862.490201:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787855862.490210:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787855862.490260:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d940 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.491095:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d939 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b40 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.491122:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d940 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b40 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.491130:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:3.0:1787855862.491133:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787855862.491136:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229600, rc 0) 00000100:00100000:3.0:1787855862.491217:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7421e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+16:10301:x1874702464217472:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 2572us (3657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855862.491228:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:1.0:1787855862.497009:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855862.497159:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464217728 00000100:00100000:2.0:1787855862.497170:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464217728 00000100:00100000:2.0:1787855862.497236:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:2.0:1787855862.497248:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+16:10301:x1874702464217728:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1787855862.497285:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855862.497312:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d947 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b47 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.497430:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d94e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.497445:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d94e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.497454:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d94e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855862.497747:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787855862.498103:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366d947 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b47 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.498128:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d94e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b47 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.498152:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73d40ac500) 00010000:00010000:2.0:1787855862.498156:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787855862.498161:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402047800, rc 0) 00000100:00100000:2.0:1787855862.498251:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:10301:x1874702464217728:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1005us (1259us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787855862.498261:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:0.0:1787855862.503659:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855862.504490:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855862.504595:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464218112 00000100:00100000:2.0:1787855862.504618:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464218112 00000100:00100000:2.0:1787855862.504806:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:2.0:1787855862.504818:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:2358:x1874702464218112:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855862.504839:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855862.504886:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d94e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b47 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.504911:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73d40ac500) 00010000:00010000:2.0:1787855862.504917:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855862.504979:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+17:2358:x1874702464218112:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 164us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855862.504987:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:3.0:1787855862.505917:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464217984 00000100:00100000:3.0:1787855862.505932:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464217984 00000100:00100000:3.0:1787855862.506003:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:3.0:1787855862.506015:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+17:10301:x1874702464217984:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855862.506045:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855862.506069:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d95c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b4e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.506190:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d963 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.506232:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d963 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.506245:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d963 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855862.506262:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787855862.506407:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d95c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b4e expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.506422:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d963 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b4e expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.506428:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73d40ac500) 00010000:00010000:3.0:1787855862.506430:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787855862.506433:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228600, rc 0) 00000100:00100000:3.0:1787855862.506491:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:10301:x1874702464217984:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 479us (2849us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787855862.506498:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:3.0:1787855862.512226:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855862.512834:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464218240 00000100:00100000:1.0:1787855862.512997:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464218240 00000100:00100000:1.0:1787855862.513089:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:1.0:1787855862.513102:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2359:x1874702464218240:12345-192.168.201.38@tcp:1:lfs.0 00010000:00010000:1.0:1787855862.513160:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce3ef308/0x516929ca3366d971 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.513184:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b32 expref: 7 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.513194:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787855862.513199:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787855862.513205:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce3ef308/0x516929ca3366d971 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.513244:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b32 expref: 7 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.513260:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b32 expref: 7 pid: 8077 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855862.513277:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6680:1874702486270976:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855862.513406:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6540 going to sleep for 11 seconds 00000100:00100000:1.0:1787855862.517643:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855862.520150:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464218368 00000100:00100000:2.0:1787855862.520171:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464218368 00002000:00100000:2.0:1787855862.520241:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9a73f9dfa1c0 x1874702464218368/t0(0) o4->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:18/0 lens 504/0 e 0 to 0 dl 1787855873 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787855862.520252:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73f9dfa1c0 with x1874702464218368 ext(0->12) 00010000:00010000:2.0:1787855862.520262:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b32 expref: 8 pid: 8077 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.520295:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b32 expref: 8 pid: 8077 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787855862.520301:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a73f9dfa1c0 00000100:00100000:2.0:1787855862.520328:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:2.0:1787855862.520335:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2358:x1874702464218368:12345-192.168.201.38@tcp:4:lfs.0 00000100:00100000:3.0:1787855862.525632:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6680:1874702486270976:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787855862.525674:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce3ef308/0x516929ca3366d971 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.526280:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787855862.634856:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6933b672-fa85-4aae-9dc8-092c3f355bbf 00000100:00100000:2.0:1787855862.637004:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2358:x1874702464218368:12345-192.168.201.38@tcp:4:lfs.0 Request processed in 116657us (119369us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787855862.637017:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00002000:00100000:2.0:1787855862.637040:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9a73f9dfa1c0 x1874702464218368/t4294967299(0) o4->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:18/0 lens 504/448 e 0 to 0 dl 1787855873 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787855862.637051:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73f9dfa1c0 with x1874702464218368 ext(0->12) 00010000:00010000:2.0:1787855862.637062:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b32 expref: 9 pid: 8077 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.637084:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b32 expref: 9 pid: 8077 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787855862.637101:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a73f9dfa1c0 00000100:00100000:3.0:1787855862.647580:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855862.648968:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464218496 00000100:00100000:2.0:1787855862.648980:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464218496 00010000:00010000:2.0:1787855862.649192:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b32 expref: 9 pid: 8077 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855862.649351:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:2.0:1787855862.649361:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2357:x1874702464218496:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855862.649376:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787855862.649394:0:7616:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787855862.649397:0:7616:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787855862 00002000:00010000:2.0:1787855862.649399:0:7616:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787855862 00002000:00010000:2.0:1787855862.649402:0:7616:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787855862 00010000:00010000:2.0:1787855862.649407:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b32 expref: 9 pid: 8077 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.649420:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b32 expref: 9 pid: 8077 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.649445:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fa98462/0x516929ca3366d924 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b32 expref: 9 pid: 8077 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.649461:0:7616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855862.649465:0:7616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855862.649470:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce3ef308/0x516929ca3366d971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.649480:0:7616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce3ef308/0x516929ca3366d971 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.649559:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855862.649634:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2357:x1874702464218496:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 274us (2063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855862.649641:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 36 00010000:00010000:1.0:1787855862.652613:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce3ef308/0x516929ca3366d971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.652651:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce3ef308/0x516929ca3366d971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.652690:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce3ef308/0x516929ca3366d971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.652699:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce3ef308/0x516929ca3366d971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.652708:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce3ef308/0x516929ca3366d971 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.652716:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787855862.652720:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce3ef308/0x516929ca3366d971 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.652729:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce3ef308/0x516929ca3366d971 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.652748:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce3ef308/0x516929ca3366d971 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.652756:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce3ef308/0x516929ca3366d971 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855862.652902:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2359:x1874702464218240:12345-192.168.201.38@tcp:1:lfs.0 Request processed in 139798us (140685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855862.652913:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:1.0:1787855862.659075:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855862.659305:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464218752 00000100:00100000:1.0:1787855862.659315:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464218752 00000100:00100000:1.0:1787855862.659366:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:1.0:1787855862.659377:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:10301:x1874702464218752:12345-192.168.201.38@tcp:35:lfs.0 00000004:00010000:1.0:1787855862.659467:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d963 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b4e expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787855862.667620:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1787855862.667719:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1787855862.668379:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1787855862.668439:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d978 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.668462:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366d908 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b24 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.668471:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d978 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.668543:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366d908 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b24 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.668560:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366d908 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b24 expref: 23 pid: 5834 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855862.668585:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33552c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874702486271104:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855862.668680:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787855862.675057:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33552c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874702486271104:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855862.675107:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d978 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855862.675218:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855862.675330:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464218880 00000100:00100000:2.0:1787855862.675338:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464218880 00010000:00010000:2.0:1787855862.675381:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366d908 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b24 expref: 24 pid: 5834 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855862.675423:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:2.0:1787855862.675432:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+24:2358:x1874702464218880:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855862.675449:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855862.675456:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366d908 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b24 expref: 24 pid: 5834 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.675468:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366d908 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b24 expref: 24 pid: 5834 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.675492:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366d908 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b24 expref: 24 pid: 5834 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.675519:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73d40ac500) 00010000:00010000:2.0:1787855862.675524:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d978 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.675532:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d978 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.675539:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d978 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.675581:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855862.675640:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+23:2358:x1874702464218880:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 210us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855862.675647:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 37 00010000:00010000:1.0:1787855862.675816:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d978 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.675824:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d978 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787855862.676114:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787855862.676386:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1787855862.677185:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa6f4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874702486271232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787855862.677286:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855862.677344:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1787855862.677380:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486271232 00000100:00100000:1.0:1787855862.677392:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486271232 00000100:00100000:1.0:1787855862.679811:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787855862.679826:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874702486271232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787855862.679970:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874702486271232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 145us (2681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855862.679977:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787855862.680038:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa6f4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874702486271232:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787855862.682540:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00080000:2.0:1787855862.683641:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787855862.688074:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400694000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874702486271360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787855862.688203:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855862.688396:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c96da0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855862.693308:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486271360 00000100:00100000:1.0:1787855862.693394:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486271360 00000100:00100000:2.0:1787855862.694287:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787855862.694309:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874702486271360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787855862.694621:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1874702486271360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 319us (6417us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787855862.694630:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787855862.694744:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400694000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874702486271360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787855862.694911:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1787855862.694977:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d978 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.694990:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d978 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.694998:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d978 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.695006:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855862.695011:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d978 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.695020:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d978 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.695041:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73d40ac500) 00010000:00010000:3.0:1787855862.695044:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787855862.695051:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d978 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.695057:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d978 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787855862.695307:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787855862.695600:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787855862.695613:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353547836546ns, next at 354547834432ns, rc = 0 00000001:00080000:3.0:1787855862.695620:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787855862.695667:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73d40ac500) 00010000:00010000:3.0:1787855862.695670:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787855862.695676:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d963 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b4e expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855862.695863:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+26:10301:x1874702464218752:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 36486us (36797us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787855862.695874:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000020:00080000:3.0:1787855862.695882:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787855862.701221:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855862.701399:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464219008 00000100:00100000:1.0:1787855862.701412:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464219008 00000100:00100000:1.0:1787855862.701487:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:1.0:1787855862.701509:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+26:10301:x1874702464219008:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787855862.701546:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855862.702670:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d97f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b55 expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.702752:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d97f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b55 expref: 27 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.702766:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d97f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b55 expref: 27 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855862.702819:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:2.0:1787855862.702823:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787855862.702827:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a7402047800, rc 0) 00000100:00100000:2.0:1787855862.704719:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+27:10301:x1874702464219008:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 3210us (3501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855862.704733:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:2.0:1787855862.719268:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855862.719388:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464219264 00000100:00100000:3.0:1787855862.719398:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464219264 00000100:00100000:3.0:1787855862.719457:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:3.0:1787855862.719467:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73dc262450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+27:10301:x1874702464219264:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1787855862.719724:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73dc262450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+28:10301:x1874702464219264:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 257us (464us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787855862.719731:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:2.0:1787855862.794753:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855862.795285:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464219520 00000100:00100000:3.0:1787855862.795296:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464219520 00000100:00100000:3.0:1787855862.795407:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:3.0:1787855862.795417:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+28:10311:x1874702464219520:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855862.795441:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855862.795463:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d986 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b5c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855862.795608:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787855862.795727:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d986 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b5c expref: 30 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.795761:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:3.0:1787855862.795764:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787855862.795771:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d986 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b5c expref: 30 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.795812:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229000, rc 0) 00000100:00100000:3.0:1787855862.795885:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+29:10311:x1874702464219520:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 468us (1140us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1787855862.795892:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:2.0:1787855862.804826:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855862.805238:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464219648 00000100:00100000:0.0:1787855862.805247:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464219648 00000100:00100000:0.0:1787855862.805308:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:0.0:1787855862.805317:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+29:10311:x1874702464219648:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:0.0:1787855862.805460:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366d994 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.805477:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366d994 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.805488:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366d994 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.805515:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366d99b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.805522:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366d99b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.805529:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366d99b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.806466:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366d9a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.806480:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366d9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.806489:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366d9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787855862.806570:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366d9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.806584:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366d994 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.806591:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366d994 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.806737:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366d994 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.806743:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855862.806747:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366d994 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.806754:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366d994 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.806767:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:0.0:1787855862.806770:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855862.807281:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366d994 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.807290:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366d994 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.807308:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366d99b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.807314:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366d99b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.807328:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366d99b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.807334:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855862.807337:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366d99b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.807345:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366d99b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.807354:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73f49fb800) 00010000:00010000:0.0:1787855862.807357:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855862.807360:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366d99b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.807366:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366d99b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.807676:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366d9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.807684:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366d9a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.807690:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366d9a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.807695:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855862.807699:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366d9a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.807717:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366d9a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.807726:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:0.0:1787855862.807728:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855862.807732:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366d9a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855862.807738:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366d9a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855862.808675:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+29:10311:x1874702464219648:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 3059us (3607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855862.808687:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:2.0:1787855862.813139:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855862.813354:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464219904 00000100:00100000:3.0:1787855862.813365:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464219904 00000100:00100000:3.0:1787855862.813431:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:3.0:1787855862.813442:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc254b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+29:10311:x1874702464219904:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1787855862.814144:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc254b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+30:10311:x1874702464219904:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 701us (1012us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787855862.814154:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:2.0:1787855862.863101:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855862.863298:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464220160 00000100:00100000:1.0:1787855862.863308:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464220160 00000100:00100000:1.0:1787855862.863381:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:1.0:1787855862.863393:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc256580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+30:10314:x1874702464220160:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787855862.863418:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855862.863440:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366d9a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b63 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.863528:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366d9b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.863552:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366d9b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.863564:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366d9b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.863581:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366d9b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.863589:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366d9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.863714:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366d9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.863920:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d9be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.863929:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d9be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.863954:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d9be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855862.863965:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787855862.864070:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366d9b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.864077:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366d9b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.865726:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366d9b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.865749:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855862.865756:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366d9b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.865764:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366d9b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.865795:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:1.0:1787855862.865798:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855862.865804:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366d9b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.865811:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366d9b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.865843:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366d9b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.865851:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366d9b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.865876:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366d9b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.865883:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855862.865886:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366d9b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.865893:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366d9b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.865901:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73c8d1d500) 00010000:00010000:1.0:1787855862.865903:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855862.865906:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366d9b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.865912:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366d9b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.865977:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366d9a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b63 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.865992:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d9be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b63 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855862.865999:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:1.0:1787855862.866001:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787855862.866004:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe400, rc 0) 00000100:00100000:1.0:1787855862.867571:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc256580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+32:10314:x1874702464220160:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 4169us (4478us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1787855862.867606:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:2.0:1787855862.872145:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855862.872363:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464220288 00000100:00100000:3.0:1787855862.872382:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464220288 00000100:00100000:3.0:1787855862.872443:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:3.0:1787855862.872453:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc254f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+32:10314:x1874702464220288:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:3.0:1787855862.872535:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d9cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.872562:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d9cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.872598:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d9cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.872629:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d9cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.872637:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d9cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.872643:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d9cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.872649:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855862.872654:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d9cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.872661:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d9cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.872674:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:3.0:1787855862.872677:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787855862.872681:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d9cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855862.872688:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d9cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855862.872848:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc254f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+32:10314:x1874702464220288:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 395us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855862.872857:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:2.0:1787855862.886132:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855862.886277:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464220544 00000100:00100000:0.0:1787855862.886292:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464220544 00000100:00100000:0.0:1787855862.886369:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:0.0:1787855862.886382:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+32:10314:x1874702464220544:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:0.0:1787855862.886741:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+33:10314:x1874702464220544:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 360us (621us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787855862.886749:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:2.0:1787855862.908687:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787855862.908711:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486271488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787855862.908844:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855862.909060:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486271488 00000100:00100000:3.0:1787855862.909081:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486271488 00000100:00100000:3.0:1787855862.909154:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787855862.909164:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486271488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787855862.909212:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855862.909258:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486271488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855862.909265:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787855862.909576:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787855862.909615:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486271488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787855863.134533:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855863.135304:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464220800 00000100:00100000:3.0:1787855863.135320:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464220800 00000100:00100000:3.0:1787855863.135405:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:3.0:1787855863.135418:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3354f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+33:10345:x1874702464220800:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:3.0:1787855863.135460:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855863.135488:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d9d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b6a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.135631:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d9da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.135661:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d9da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.136401:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d9da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855863.136421:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787855863.136886:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366d9d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b6a expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.136909:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d9da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b6a expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.136937:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:3.0:1787855863.136940:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787855863.136945:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228600, rc 0) 00000100:00100000:3.0:1787855863.137171:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3354f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+35:10345:x1874702464220800:12345-192.168.201.38@tcp:101:cat.0 Request processed in 1752us (2678us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787855863.137182:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:2.0:1787855863.145531:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855863.145604:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855863.145770:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464221056 00000100:00100000:0.0:1787855863.145812:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464221056 00000100:00100000:0.0:1787855863.145894:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:0.0:1787855863.145906:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+35:10345:x1874702464221056:12345-192.168.201.38@tcp:35:cat.0 00000100:00100000:0.0:1787855863.146454:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+36:10345:x1874702464221056:12345-192.168.201.38@tcp:35:cat.0 Request processed in 547us (936us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787855863.146485:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:3.0:1787855863.147397:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464221184 00000100:00100000:3.0:1787855863.147409:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464221184 00000100:00100000:3.0:1787855863.147478:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:3.0:1787855863.147488:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c53dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+36:2357:x1874702464221184:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787855863.147515:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855863.147549:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d9da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b6a expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.147573:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:3.0:1787855863.147580:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855863.147634:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c53dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+35:2357:x1874702464221184:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 147us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855863.147839:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:2.0:1787855863.217134:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855863.217270:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464221440 00000100:00100000:3.0:1787855863.217283:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464221440 00000100:00100000:3.0:1787855863.217370:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:3.0:1787855863.217383:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2358:x1874702464221440:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855863.231371:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2358:x1874702464221440:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 13970us (14237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855863.231414:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:2.0:1787855863.232655:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855863.233060:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855863.233227:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464221312 00000100:00100000:1.0:1787855863.233242:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464221312 00000100:00100000:1.0:1787855863.233334:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 285 00000100:00100000:1.0:1787855863.233346:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2358:x1874702464221312:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855863.233443:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7165050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2358:x1874702464221312:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 99us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855863.233452:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 285 00000100:00100000:3.0:1787855863.235268:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464221568 00000100:00100000:3.0:1787855863.235284:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464221568 00000100:00100000:3.0:1787855863.235386:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 134 00000100:00100000:3.0:1787855863.235399:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2358:x1874702464221568:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855863.235522:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2358:x1874702464221568:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 127us (2463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855863.235531:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 134 00000100:00080000:2.0:1787855863.236463:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855863.345368:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855863.345834:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464221824 00000100:00100000:1.0:1787855863.345847:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464221824 00000100:00100000:1.0:1787855863.346112:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:1.0:1787855863.346125:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+35:10351:x1874702464221824:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:1.0:1787855863.346158:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855863.346163:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787855863.346207:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366d940 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b40 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855863.346231:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:1.0:1787855863.346238:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787855863.346256:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366d9e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b71 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855863.346385:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d9ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855863.346468:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d9be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b63 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855863.346506:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d9ef lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855863.346548:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d9be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b63 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855863.346565:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d9be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b63 expref: 35 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855863.346582:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33552c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874702486271616:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855863.347066:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787855863.349010:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855863.349095:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464221952 00000100:00100000:2.0:1787855863.349105:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464221952 00010000:00010000:2.0:1787855863.349167:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d9be lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b63 expref: 36 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855863.349322:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:2.0:1787855863.349335:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+36:2357:x1874702464221952:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855863.349353:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855863.349361:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d9be lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b63 expref: 36 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855863.349403:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d9be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b63 expref: 36 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855863.349433:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:2.0:1787855863.349439:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d9ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855863.349450:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d9ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855863.349459:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d9ef lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855863.349482:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855863.349551:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+36:2357:x1874702464221952:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 218us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855863.349560:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 38 00010000:00010000:3.0:1787855863.349797:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366d9be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b63 expref: 35 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855863.349818:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33552c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874702486271616:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787855863.349851:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d9ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.349862:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d9ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.349869:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d9ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855863.349890:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787855863.350115:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366d9e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b71 expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.350132:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d9ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b71 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.350155:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:3.0:1787855863.350158:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787855863.350161:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ffa00, rc 0) 00000100:00100000:3.0:1787855863.350194:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+35:10351:x1874702464221824:12345-192.168.201.38@tcp:101:dd.0 Request processed in 4072us (4841us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787855863.350202:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:3.0:1787855863.352087:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855863.352133:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464222208 00000100:00100000:3.0:1787855863.352143:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464222208 00000100:00100000:3.0:1787855863.352199:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:3.0:1787855863.352209:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+35:10351:x1874702464222208:12345-192.168.201.38@tcp:36:dd.0 00010000:00010000:3.0:1787855863.352861:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d9fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.352883:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d9fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.352897:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d9fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787855863.352959:0:9629:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1787855863.352987:0:9629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2fbbd70 reply state 00000000e8f1f97c transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d9fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855863.352997:0:9629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787855863.353146:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+38:10351:x1874702464222208:12345-192.168.201.38@tcp:36:dd.0 Request processed in 936us (1070us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787855863.353156:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 52 00000020:00080000:3.0:1787855863.353180:0:9629:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787855863.360344:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d9fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855863.360366:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d9fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855863.360375:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d9fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855863.360383:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855863.360389:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d9fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855863.360462:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d9fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855863.360493:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:1.0:1787855863.360518:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855863.360525:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d9fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855863.360533:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366d9fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855863.420588:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486271744:0@lo:400:kworker.0 00000100:00100000:2.0:1787855863.420690:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855863.420696:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f763e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486272000:0@lo:400:kworker.0 00000100:00100000:2.0:1787855863.420766:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486272256:0@lo:400:kworker.0 00000100:00100000:3.0:1787855863.420808:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855863.420851:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486271744 00000100:00100000:2.0:1787855863.420861:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486271744 00000100:00100000:3.0:1787855863.420864:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787855863.420873:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7423840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486271872:0@lo:400:kworker.0 00000100:00100000:3.0:1787855863.420905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855863.420920:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787855863.420928:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486272384:0@lo:400:kworker.0 00000100:00100000:2.0:1787855863.420934:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486271744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855863.420959:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855863.420994:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486272384 00000100:00100000:3.0:1787855863.420998:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486272384 00000100:00100000:3.0:1787855863.421035:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787855863.421042:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486272128:0@lo:400:kworker.0 00000100:00100000:3.0:1787855863.421045:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874702486272384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855863.421728:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486272000 00000100:00100000:1.0:1787855863.421734:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486272000 00000100:00100000:1.0:1787855863.421800:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486271872 00000100:00100000:1.0:1787855863.421803:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486271872 00000100:00100000:1.0:1787855863.421824:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787855863.421832:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486272000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855863.422112:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787855863.422122:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486271872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855863.422171:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486271872:12345-0@lo:400:kworker.0 Request processed in 52us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855863.422180:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787855863.422230:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7423840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486271872:0@lo:400:kworker.0 00000100:00080000:0.0:1787855863.422269:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855863.422296:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855863.422334:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486272128 00000100:00100000:0.0:1787855863.422338:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486272128 00000100:00100000:0.0:1787855863.422362:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787855863.422368:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486272128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855863.422401:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486272128:12345-0@lo:400:kworker.0 Request processed in 33us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855863.422408:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787855863.422434:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486272128:0@lo:400:kworker.0 00000100:00100000:3.0:1787855863.423032:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874702486272384:12345-0@lo:400:kworker.0 Request processed in 1986us (2069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855863.423041:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787855863.423074:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855863.423099:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486272384:0@lo:400:kworker.0 00000100:00100000:3.0:1787855863.423186:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486272256 00000100:00100000:3.0:1787855863.423192:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486272256 00000100:00100000:3.0:1787855863.423227:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787855863.423234:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486272256:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787855863.423262:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855863.423307:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486272256:0@lo:400:kworker.0 00000100:00100000:3.0:1787855863.423368:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486272256:12345-0@lo:400:kworker.0 Request processed in 133us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855863.423377:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787855863.423421:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486271744:12345-0@lo:400:kworker.0 Request processed in 2488us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855863.423451:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787855863.423557:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486272000:12345-0@lo:400:kworker.0 Request processed in 1725us (2749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855863.423566:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787855863.423630:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486271744:0@lo:400:kworker.0 00000100:00100000:3.0:1787855863.423900:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f763e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486272000:0@lo:400:kworker.0 00010000:00010000:2.0:1787855863.548139:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855863.589314:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855863.589636:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464222336 00000100:00100000:0.0:1787855863.589666:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464222336 00000100:00100000:0.0:1787855863.589740:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:0.0:1787855863.589752:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+37:10365:x1874702464222336:12345-192.168.201.38@tcp:101:stat.0 00010000:00010000:0.0:1787855863.589817:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855863.589848:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366da04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b78 expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.589938:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da0b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.589955:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.589970:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.589986:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.589994:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.590002:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.590119:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366da19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.590131:0:9629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d9ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b71 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.590140:0:9629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366da19 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.590187:0:9629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d9ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b71 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.590203:0:9629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d9ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b71 expref: 38 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855863.590220:0:9629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa6f6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9629:1874702486272512:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787855863.590345:0:9629:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73f7880f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787855863.592898:0:9629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa6f6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9629:1874702486272512:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855863.592938:0:9629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366da19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855863.593203:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855863.593282:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464222592 00000100:00100000:0.0:1787855863.593291:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464222592 00000100:00100000:0.0:1787855863.593350:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:0.0:1787855863.593360:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+39:5595:x1874702464222592:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787855863.594190:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+40:5595:x1874702464222592:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 824us (981us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1787855863.594203:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:2.0:1787855863.599481:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855863.599612:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464222720 00000100:00100000:3.0:1787855863.599646:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464222720 00010000:00010000:3.0:1787855863.599710:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d9ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b71 expref: 40 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855863.599760:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:3.0:1787855863.599772:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+40:2357:x1874702464222720:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787855863.599840:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855863.599849:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d9ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b71 expref: 40 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.599865:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d9ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b71 expref: 40 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.599894:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366d9ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b71 expref: 40 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.599915:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:3.0:1787855863.599922:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366da19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.599934:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366da19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.599942:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366da19 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.599969:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855863.600043:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+39:2357:x1874702464222720:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 273us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855863.600062:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00010000:00010000:0.0:1787855863.600992:0:9629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366da19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601008:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366da19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855863.601069:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787855863.601084:0:9629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787855863.601155:0:9629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366da19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601173:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366da19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601185:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601193:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601202:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601209:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855863.601214:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601223:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601237:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:0.0:1787855863.601240:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855863.601246:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601253:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601269:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601286:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601293:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601299:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855863.601302:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601309:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601316:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73f49fb800) 00010000:00010000:0.0:1787855863.601319:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855863.601322:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601329:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601377:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366da04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b78 expref: 39 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601393:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366da19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b78 expref: 38 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855863.601401:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:0.0:1787855863.601404:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787855863.601411:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142400, rc 0) 00000100:00100000:0.0:1787855863.601503:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+38:10365:x1874702464222336:12345-192.168.201.38@tcp:101:stat.0 Request processed in 11735us (12186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855863.601514:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:2.0:1787855863.695717:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855863.696270:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464222976 00000100:00100000:3.0:1787855863.696284:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464222976 00000100:00100000:3.0:1787855863.696371:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:3.0:1787855863.696385:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+38:10371:x1874702464222976:12345-192.168.201.38@tcp:36:truncate.0 00010000:00010000:3.0:1787855863.696504:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855863.696542:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366da19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b78 expref: 38 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.696571:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:3.0:1787855863.696578:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787855863.697061:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.697080:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.697094:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787855863.697154:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1787855863.699054:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a179dcb reply state 000000008566548b transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855863.699077:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787855863.700514:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+40:10371:x1874702464222976:12345-192.168.201.38@tcp:36:truncate.0 Request processed in 4092us (4771us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787855863.700531:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 54 00000020:00080000:3.0:1787855863.700559:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787855863.709435:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.709459:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.709467:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.709475:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855863.709489:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.709500:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.709523:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:3.0:1787855863.709527:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855863.709533:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.709540:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855863.903880:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855863.904002:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464223104 00000100:00100000:3.0:1787855863.904015:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464223104 00000100:00100000:3.0:1787855863.904080:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:3.0:1787855863.904099:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+39:10385:x1874702464223104:12345-192.168.201.38@tcp:101:stat.0 00010000:00010000:3.0:1787855863.904134:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855863.904163:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b7f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904276:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366da2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904304:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366da2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904318:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366da2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904337:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904345:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904352:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904503:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366da3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904513:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366da3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904520:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366da3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855863.904566:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787855863.904571:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787855863.904850:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366da3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904880:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366da3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904890:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366da2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904899:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366da2e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904907:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366da2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904914:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855863.904920:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366da2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904929:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366da2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904944:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:3.0:1787855863.904948:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855863.904953:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366da2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904960:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366da2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904977:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904983:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.904996:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.905002:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855863.905005:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.905011:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.905020:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73d40ac500) 00010000:00010000:3.0:1787855863.905022:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855863.905025:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.905032:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.905073:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b7f expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.905087:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366da3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b7f expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.905106:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:3.0:1787855863.905108:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787855863.905111:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229600, rc 0) 00000100:00100000:3.0:1787855863.905204:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+40:10385:x1874702464223104:12345-192.168.201.38@tcp:101:stat.0 Request processed in 1114us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855863.905224:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 55 00000004:00080000:0.0:1787855863.933378:0:8076:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354785598607ns, next at 355785595535ns, rc = 0 00000100:00100000:1.0:1787855863.933446:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787855863.933502:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa6f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486272640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787855863.933601:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855863.933857:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486272640 00000100:00100000:2.0:1787855863.933867:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486272640 00000100:00100000:2.0:1787855863.933925:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787855863.933936:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7649e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874702486272640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787855863.933966:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787855863.934025:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7649e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874702486272640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855863.934033:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787855863.934146:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa6f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486272640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787855863.998189:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855863.998295:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464223360 00000100:00100000:3.0:1787855863.998309:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464223360 00000100:00100000:3.0:1787855863.998390:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:3.0:1787855863.998403:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+40:10395:x1874702464223360:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855863.998430:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855863.998458:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b86 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855863.998627:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787855863.999464:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b86 expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.999493:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:3.0:1787855863.999497:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787855863.999504:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b86 expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855863.999525:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229000, rc 0) 00000100:00100000:3.0:1787855863.999884:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+41:10395:x1874702464223360:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1480us (1719us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1787855863.999894:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:1.0:1787855864.016922:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855864.017026:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464223616 00000100:00100000:3.0:1787855864.017039:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464223616 00000100:00100000:3.0:1787855864.017133:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:3.0:1787855864.017147:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9280f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+41:10395:x1874702464223616:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1787855864.017531:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9280f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+42:10395:x1874702464223616:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 387us (624us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787855864.017541:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00080000:2.0:1787855864.020062:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855864.133683:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855864.133842:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464223872 00000100:00100000:0.0:1787855864.133854:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464223872 00000100:00100000:0.0:1787855864.133929:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:0.0:1787855864.133940:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+42:10401:x1874702464223872:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1787855864.133973:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855864.134003:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366da51 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b8d expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.134148:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da58 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.134179:0:9629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366da3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b7f expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.134190:0:9629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da58 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.134235:0:9629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366da3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b7f expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.134252:0:9629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366da3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b7f expref: 43 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855864.134307:0:9629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa6f6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9629:1874702486272768:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787855864.134433:0:9629:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73f7880180 going to sleep for 11 seconds 00000100:00100000:1.0:1787855864.141239:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855864.142094:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464224000 00000100:00100000:2.0:1787855864.142109:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464224000 00010000:00010000:2.0:1787855864.142191:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366da3c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b7f expref: 44 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855864.142243:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:2.0:1787855864.142256:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c92803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+44:2358:x1874702464224000:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855864.142415:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855864.142424:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366da3c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b7f expref: 44 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855864.142441:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366da3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b7f expref: 44 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855864.142498:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:2.0:1787855864.142505:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da58 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855864.142516:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855864.142524:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da58 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855864.142549:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855864.143072:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c92803c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+44:2358:x1874702464224000:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 814us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855864.143083:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 40 00010000:00010000:0.0:1787855864.145962:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366da3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b7f expref: 43 pid: 5833 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855864.145994:0:9629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa6f6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9629:1874702486272768:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855864.146029:0:9629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.146041:0:9629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.146048:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da58 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855864.146087:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787855864.146442:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366da51 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b8d expref: 44 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.146466:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b8d expref: 43 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.146485:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:0.0:1787855864.146489:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787855864.146493:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143a00, rc 0) 00000100:00100000:0.0:1787855864.146588:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+43:10401:x1874702464223872:12345-192.168.201.38@tcp:101:bash.0 Request processed in 12648us (12921us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787855864.147542:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:1.0:1787855864.157977:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855864.158122:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464224256 00000100:00100000:0.0:1787855864.158136:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464224256 00000100:00100000:0.0:1787855864.158435:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:0.0:1787855864.158448:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9282580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+43:10401:x1874702464224256:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:1.0:1787855864.159942:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366da66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.159971:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366da66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.159988:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366da66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787855864.160066:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1787855864.160260:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022c09f8d reply state 000000008051a5e0 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366da66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855864.160337:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787855864.161467:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9282580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+46:10401:x1874702464224256:12345-192.168.201.38@tcp:36:bash.0 Request processed in 3009us (3494us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787855864.161490:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 58 00000020:00080000:1.0:1787855864.161499:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787855864.171454:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366da66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.171490:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366da66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.171499:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366da66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.171512:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fee00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855864.171518:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366da66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.171527:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366da66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.171549:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:0.0:1787855864.171553:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855864.171559:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366da66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.171574:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366da66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855864.178242:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855864.178425:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464224384 00000100:00100000:3.0:1787855864.178439:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464224384 00000100:00100000:3.0:1787855864.178581:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:3.0:1787855864.178594:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9280b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+45:10401:x1874702464224384:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1787855864.178638:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855864.178666:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b94 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.178834:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.178852:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da58 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b8d expref: 46 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.178862:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da74 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.178907:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da58 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b8d expref: 46 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.178924:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da58 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b8d expref: 46 pid: 9629 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855864.178941:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74bf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486272896:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855864.179872:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d08aa840 going to sleep for 11 seconds 00000100:00100000:1.0:1787855864.194901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855864.195159:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464224512 00000100:00100000:3.0:1787855864.195172:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464224512 00010000:00010000:3.0:1787855864.195228:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da58 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b8d expref: 47 pid: 9629 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855864.195270:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:3.0:1787855864.195281:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c92830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+47:2358:x1874702464224512:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787855864.195302:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855864.195310:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da58 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b8d expref: 47 pid: 9629 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.195326:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da58 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b8d expref: 47 pid: 9629 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.195357:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:3.0:1787855864.195364:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.195375:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.195385:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da74 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.195408:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855864.195489:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c92830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+47:2358:x1874702464224512:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 209us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855864.195499:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 41 00010000:00010000:0.0:1787855864.195817:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da58 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b8d expref: 46 pid: 9629 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855864.195857:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74bf0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486272896:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855864.195882:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.195893:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.195898:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855864.195957:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787855864.195963:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787855864.195988:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.196026:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366da6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b94 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.196043:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b94 expref: 45 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.196052:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:0.0:1787855864.196055:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787855864.196059:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228600, rc 0) 00000100:00100000:0.0:1787855864.196106:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9280b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+45:10401:x1874702464224384:12345-192.168.201.38@tcp:101:bash.0 Request processed in 17515us (17881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855864.196114:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:0.0:1787855864.199960:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855864.200904:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464224768 00000100:00100000:3.0:1787855864.200938:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464224768 00000100:00100000:3.0:1787855864.201017:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:3.0:1787855864.201030:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73dc260050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+45:10401:x1874702464224768:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:3.0:1787855864.202026:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73dc260050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+46:10401:x1874702464224768:12345-192.168.201.38@tcp:35:bash.0 Request processed in 990us (2073us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1787855864.202039:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000040:00080000:0.0:1787855864.252922:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787855864.310382:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855864.310599:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464225024 00000100:00100000:3.0:1787855864.310614:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464225024 00000100:00100000:3.0:1787855864.310699:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:3.0:1787855864.310713:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+46:10411:x1874702464225024:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855864.310743:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855864.310770:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366da7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616b9b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855864.311111:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787855864.311456:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366da7b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b9b expref: 48 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.311484:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:3.0:1787855864.311487:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787855864.311492:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366da7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b9b expref: 48 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.311506:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228a00, rc 0) 00000100:00100000:3.0:1787855864.311626:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+47:10411:x1874702464225024:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 916us (1255us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1787855864.311637:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:1.0:1787855864.320967:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855864.321191:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464225152 00000100:00100000:0.0:1787855864.321203:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464225152 00000100:00100000:0.0:1787855864.321291:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:0.0:1787855864.321303:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9281680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+47:10411:x1874702464225152:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:0.0:1787855864.321409:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366da89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.321430:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366da89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.321443:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366da89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.321459:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.321466:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.321484:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.321836:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.321847:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.321855:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787855864.321937:0:9629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.321953:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366da89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.321959:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366da89 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.321966:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366da89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.321972:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855864.321977:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366da89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.321985:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366da89 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.322000:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:0.0:1787855864.322003:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855864.322007:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366da89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.322012:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366da89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.322029:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.322032:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.322042:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.322045:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855864.322047:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.322050:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.322055:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73f49fb800) 00010000:00010000:0.0:1787855864.322057:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855864.322059:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.322062:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366da90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.322073:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.322076:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.322079:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.322083:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855864.322085:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.322094:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.322099:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:0.0:1787855864.322100:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855864.322102:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.322105:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366da97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855864.322250:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9281680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+47:10411:x1874702464225152:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 946us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855864.322260:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:0.0:1787855864.327185:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855864.327366:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464225408 00000100:00100000:1.0:1787855864.327379:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464225408 00000100:00100000:1.0:1787855864.327499:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:1.0:1787855864.327512:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+47:10411:x1874702464225408:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1787855864.327913:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+48:10411:x1874702464225408:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 403us (743us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787855864.327923:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:2.0:1787855864.372432:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855864.372752:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464225664 00000100:00100000:1.0:1787855864.372766:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464225664 00000100:00100000:1.0:1787855864.372914:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:1.0:1787855864.372927:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+48:10414:x1874702464225664:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787855864.372960:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855864.373008:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366da9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616ba2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.373135:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366daa5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.373154:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366daa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.373169:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366daa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.373210:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.373220:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.373227:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.373405:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dab3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.373415:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.373424:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855864.373436:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787855864.373592:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366daa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.373997:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366daa5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.374005:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366daa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.374012:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855864.374018:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366daa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.374027:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366daa5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.374043:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:1.0:1787855864.374047:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855864.374053:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366daa5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.374061:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366daa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.374079:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.374086:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.374092:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.374097:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855864.374286:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.374295:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.374304:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73c8d1dd00) 00010000:00010000:1.0:1787855864.374306:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855864.374310:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.374316:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.375535:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366da9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ba2 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.375565:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ba2 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.376000:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:0.0:1787855864.376003:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787855864.376007:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe400, rc 0) 00000100:00100000:0.0:1787855864.376225:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+50:10414:x1874702464225664:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 3298us (3805us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787855864.376237:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:2.0:1787855864.380994:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855864.381080:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855864.381152:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464225920 00000100:00100000:1.0:1787855864.381166:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464225920 00000100:00100000:1.0:1787855864.381245:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:1.0:1787855864.381258:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+50:10414:x1874702464225920:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:1.0:1787855864.381350:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366dac1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.381373:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366dac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.381387:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366dac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.381420:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366dac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.381428:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366dac1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.381457:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366dac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.381463:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855864.381477:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366dac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.381486:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366dac1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.381500:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:1.0:1787855864.381504:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787855864.381510:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366dac1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.381516:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366dac1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855864.382067:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+50:10414:x1874702464225920:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 808us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855864.382077:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:3.0:1787855864.382269:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464225792 00000100:00100000:3.0:1787855864.382276:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464225792 00000100:00100000:3.0:1787855864.382333:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:3.0:1787855864.382343:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+50:2357:x1874702464225792:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787855864.382359:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855864.382381:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dab3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ba2 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.382395:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:3.0:1787855864.382400:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855864.382429:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+49:2357:x1874702464225792:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 89us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855864.382436:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:2.0:1787855864.385131:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855864.385226:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464226176 00000100:00100000:3.0:1787855864.385240:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464226176 00000100:00100000:3.0:1787855864.385347:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:3.0:1787855864.385360:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9731e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+49:10414:x1874702464226176:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1787855864.385707:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9731e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+50:10414:x1874702464226176:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 349us (590us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787855864.385716:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:2.0:1787855864.515327:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855864.515439:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464226432 00000100:00100000:3.0:1787855864.515453:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464226432 00000100:00100000:3.0:1787855864.515543:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:3.0:1787855864.515555:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c97303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+50:10432:x1874702464226432:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:3.0:1787855864.515600:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855864.515640:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366dac8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616ba9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.515857:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dacf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.515875:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dacf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.515888:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dacf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855864.515899:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787855864.516068:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366dac8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ba9 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.516090:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dacf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ba9 expref: 52 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.516101:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:3.0:1787855864.516105:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787855864.516110:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228e00, rc 0) 00000100:00100000:3.0:1787855864.516192:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c97303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:10432:x1874702464226432:12345-192.168.201.38@tcp:101:cat.0 Request processed in 639us (881us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1787855864.516201:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:2.0:1787855864.536188:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855864.536315:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464226560 00000100:00100000:0.0:1787855864.536346:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464226560 00000100:00100000:0.0:1787855864.536428:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:0.0:1787855864.536440:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:10433:x1874702464226560:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1787855864.536482:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855864.536512:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366dadd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616bb0 expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.536831:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366dae4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.536850:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366dae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.536865:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366dae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855864.536950:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787855864.536955:0:9629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787855864.536983:0:9629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366dae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.537017:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366dadd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bb0 expref: 54 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.537044:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366dae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bb0 expref: 53 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855864.537055:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:0.0:1787855864.537059:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787855864.537064:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142a00, rc 0) 00000100:00100000:0.0:1787855864.537194:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+53:10433:x1874702464226560:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 756us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855864.537203:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:2.0:1787855864.541495:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855864.541606:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464226944 00000100:00100000:1.0:1787855864.541635:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464226944 00000100:00100000:1.0:1787855864.541746:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:1.0:1787855864.541759:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c97312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+53:10433:x1874702464226944:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1787855864.542250:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c97312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:10433:x1874702464226944:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 493us (780us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787855864.542260:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:2.0:1787855864.546451:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855864.546576:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464227072 00000100:00100000:3.0:1787855864.546595:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464227072 00000100:00100000:3.0:1787855864.546703:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:3.0:1787855864.546717:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9731680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:10433:x1874702464227072:12345-192.168.201.38@tcp:103:lfs.0 00010000:00010000:3.0:1787855864.546746:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787855864.547064:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366da74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b94 expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.547094:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dacf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ba9 expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.547106:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366d97f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b55 expref: 52 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.547119:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093200) 00010000:00010000:3.0:1787855864.547133:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855864.547205:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9731680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+51:10433:x1874702464227072:12345-192.168.201.38@tcp:103:lfs.0 Request processed in 489us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855864.547215:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:2.0:1787855864.550256:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855864.550369:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464227200 00000100:00100000:3.0:1787855864.550382:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464227200 00000100:00100000:3.0:1787855864.550502:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:3.0:1787855864.550515:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9731a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+51:10433:x1874702464227200:12345-192.168.201.38@tcp:58:lfs.0 00010000:00010000:3.0:1787855864.550724:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366daeb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.550746:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366daeb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855864.550761:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366daeb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787855864.551239:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787855864.551454:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1787855864.551556:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1787855864.551703:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9731a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+51:10433:x1874702464227200:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 1186us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855864.551715:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 66 00010000:00010000:1.0:1787855864.572013:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855864.573178:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855864.573398:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464227328 00000100:00100000:1.0:1787855864.573412:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464227328 00000100:00100000:1.0:1787855864.573549:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:1.0:1787855864.573573:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+51:10435:x1874702464227328:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787855864.573602:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855864.573646:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366daf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616bb7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.573984:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daf9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574004:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574017:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574034:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366db00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574041:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366db00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574047:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366db00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574237:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366db07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574246:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366db07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574275:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366db07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855864.574319:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787855864.574324:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787855864.574347:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366db07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574360:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366db07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574368:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574375:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daf9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574383:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574390:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855864.574395:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574402:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daf9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574416:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:1.0:1787855864.574419:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855864.574424:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574443:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366daf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574460:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366db00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574477:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366db00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574482:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366db00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574487:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855864.574491:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366db00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574497:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366db00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574504:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73c8d1dd00) 00010000:00010000:1.0:1787855864.574507:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855864.574509:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366db00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574516:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366db00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574554:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366daf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bb7 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574570:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366db07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bb7 expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855864.574584:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73d40ac500) 00010000:00010000:1.0:1787855864.574587:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787855864.574589:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ff200, rc 0) 00000100:00100000:1.0:1787855864.575069:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:10435:x1874702464227328:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1506us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855864.575079:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 67 00000040:00080000:1.0:1787855865.301273:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787855865.301288:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787855865.303312:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787855865.303326:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787855865.304077:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9280f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874702486273024:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787855865.307473:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6000 going to sleep for 11 seconds 00000100:00100000:0.0:1787855865.327860:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9280f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874702486273024:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787855865.343137:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855865.343194:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464227456 00000100:00100000:2.0:1787855865.343206:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464227456 00000100:00100000:2.0:1787855865.343277:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:2.0:1787855865.343305:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:10446:x1874702464227456:12345-192.168.201.38@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787855865.343428:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:10446:x1874702464227456:12345-192.168.201.38@tcp:900:lhsmtool_posix.0 Request processed in 126us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855865.343437:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:0.0:1787855865.360261:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855865.360321:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464227584 00000100:00100000:0.0:1787855865.360335:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464227584 00000100:00100000:0.0:1787855865.360416:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:0.0:1787855865.360429:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:10446:x1874702464227584:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787855865.360486:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787855865.360653:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:10446:x1874702464227584:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 225us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855865.361139:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:2.0:1787855865.381253:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855865.381848:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464227712 00000100:00100000:0.0:1787855865.381862:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464227712 00000100:00100000:0.0:1787855865.381939:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:0.0:1787855865.381952:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1379680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:10446:x1874702464227712:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787855865.382067:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366db0e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382090:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366db0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382106:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366db0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382126:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db15 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382152:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382159:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382191:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382201:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382208:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855865.382256:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787855865.382261:0:9629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787855865.382280:0:9629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382293:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366db0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382299:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366db0e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382307:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366db0e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382314:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855865.382318:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366db0e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382332:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366db0e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382358:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a73d40ac700) 00010000:00010000:0.0:1787855865.382362:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855865.382369:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366db0e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382377:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366db0e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382397:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382404:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db15 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382411:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db15 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382417:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855865.382420:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db15 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382427:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db15 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382435:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9a73f49fb800) 00010000:00010000:0.0:1787855865.382438:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855865.382441:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db15 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382468:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db15 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382485:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382492:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382508:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382514:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855865.382518:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382525:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382532:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73d40ac500) 00010000:00010000:0.0:1787855865.382535:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855865.382538:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.382545:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855865.382648:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1379680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:10446:x1874702464227712:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 Request processed in 698us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855865.382658:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:2.0:1787855865.396053:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855865.396275:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464227968 00000100:00100000:0.0:1787855865.396289:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464227968 00000100:00100000:0.0:1787855865.396379:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:0.0:1787855865.396392:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1378b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:10446:x1874702464227968:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787855865.396423:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855865.396461:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db23 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616bbe expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.396614:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.396633:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.396648:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855865.396661:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787855865.396820:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.396829:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.396837:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.396843:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855865.396847:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.396856:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.396884:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73d40ac500) 00010000:00010000:0.0:1787855865.396887:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787855865.396894:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.396901:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.396956:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db23 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bbe expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.396968:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a73d40ac700) 00010000:00010000:0.0:1787855865.396971:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787855865.396974:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db23 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bbe expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.396984:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142e00, rc 0) 00000100:00100000:0.0:1787855865.398173:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1378b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+53:10446:x1874702464227968:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1775us (2141us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1787855865.398186:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:1.0:1787855865.408373:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855865.408540:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464228096 00000100:00100000:0.0:1787855865.408553:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464228096 00000100:00100000:0.0:1787855865.408628:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 71 00000100:00100000:0.0:1787855865.408640:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9280f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+53:10446:x1874702464228096:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787855865.408689:0:9629:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787855865.408853:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9280f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+53:10446:x1874702464228096:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 215us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855865.408874:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 71 00000100:00100000:1.0:1787855865.428212:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855865.430236:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464228352 00000100:00100000:3.0:1787855865.430256:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464228352 00000100:00100000:3.0:1787855865.430349:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:3.0:1787855865.430363:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+53:10446:x1874702464228352:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787855865.430392:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855865.430397:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787855865.430432:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366dae4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bb0 expref: 53 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.430467:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:3.0:1787855865.430475:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787855865.430493:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366db38 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616bc5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787855865.435620:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787855865.440980:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366db3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.441015:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366db3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.441032:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366db3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.443235:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366db38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bc5 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.443275:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366db3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bc5 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.443287:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a73d40ac200) 00010000:00010000:3.0:1787855865.443291:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787855865.443295:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228600, rc 0) 00000100:00100000:3.0:1787855865.448840:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:10446:x1874702464228352:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 15661us (17825us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787855865.448865:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:2.0:1787855865.462993:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855865.463823:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464228608 00000100:00100000:0.0:1787855865.463839:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464228608 00000100:00100000:0.0:1787855865.463924:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:0.0:1787855865.463939:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1378f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:10446:x1874702464228608:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787855865.464040:0:9629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855865.464077:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366db3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bc5 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.464100:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a73d40ac200) 00010000:00010000:0.0:1787855865.464113:0:9629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787855865.464147:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.464163:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.464174:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.470737:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xeb8520bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.470763:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb8520bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.470790:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb8520bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.470919:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.470927:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db4d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.470934:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.470941:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855865.470946:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.470954:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db4d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.470979:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:0.0:1787855865.470983:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855865.470987:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db4d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.470993:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366db4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.471009:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb8520bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.471016:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb8520bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.471023:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb8520bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.471035:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855865.471039:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb8520bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.471045:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xeb8520bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.471053:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xeb8520bf (ffff9a73f49fb800) 00010000:00010000:0.0:1787855865.471055:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855865.471058:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xeb8520bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.471065:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xeb8520bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855865.471196:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1378f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+53:10446:x1874702464228608:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 7254us (8210us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787855865.471207:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:2.0:1787855865.484598:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855865.484965:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464228736 00000100:00100000:3.0:1787855865.484979:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464228736 00000100:00100000:3.0:1787855865.485065:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:3.0:1787855865.485078:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+53:10446:x1874702464228736:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787855865.485106:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855865.485138:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366db5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616bcc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.485188:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366db62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.485207:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366db62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.485221:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366db62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.485352:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366db5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bcc expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.485384:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366db62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bcc expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.485395:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a73d40ac300) 00010000:00010000:3.0:1787855865.485399:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787855865.485403:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228800, rc 0) 00000100:00100000:3.0:1787855865.485483:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:10446:x1874702464228736:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 408us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855865.485491:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:2.0:1787855865.493062:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855865.493101:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464228992 00000100:00100000:2.0:1787855865.493110:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464228992 00000100:00100000:2.0:1787855865.493159:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:2.0:1787855865.493169:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:10446:x1874702464228992:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787855865.495183:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366db69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855865.495210:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366db69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855865.495224:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366db69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787855865.500656:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1787855865.500675:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356352898700ns, next at 357352895352ns, rc = 0 00000004:00010000:2.0:1787855865.500903:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ba56f68 reply state 00000000b3d74293 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366db69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855865.500916:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787855865.501071:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:10446:x1874702464228992:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 7898us (8014us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1787855865.501080:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 75 00010000:00010000:0.0:1787855865.510582:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366db69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.510599:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366db69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.510608:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366db69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.510616:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402047400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855865.510621:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366db69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.510643:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366db69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.510660:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a73d40ac300) 00010000:00010000:0.0:1787855865.510663:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787855865.510668:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366db69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.510675:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366db69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855865.510732:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855865.512150:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464229120 00000100:00100000:0.0:1787855865.512163:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464229120 00000100:00100000:0.0:1787855865.512232:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:0.0:1787855865.512247:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:10446:x1874702464229120:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787855865.512272:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855865.512294:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616bd3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.512357:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bd3 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.512372:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bd3 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.512403:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a73d40ac300) 00010000:00010000:0.0:1787855865.512406:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787855865.512409:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142400, rc 0) 00000100:00100000:0.0:1787855865.512500:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:10446:x1874702464229120:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 258us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855865.512508:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:0.0:1787855865.541027:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855865.541217:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464229248 00000100:00100000:3.0:1787855865.541231:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464229248 00000100:00100000:3.0:1787855865.541280:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:3.0:1787855865.541291:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2356:x1874702464229248:12345-192.168.201.38@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787855865.541332:0:6680:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:3.0:1787855865.541378:0:6680:0:(genops.c:1385:class_connect()) connect: client 6933b672-fa85-4aae-9dc8-092c3f355bbf, cookie 0x516929ca3366db77 00002000:00100000:3.0:1787855865.541392:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6933b672-fa85-4aae-9dc8-092c3f355bbf/ffff9a7400498000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787855865.541424:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787855865.542200:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787855865.542252:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9a740049e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787855865.542462:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2356:x1874702464229248:12345-192.168.201.38@tcp:8:lhsmtool_posix.0 Request processed in 1170us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855865.542474:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:3.0:1787855865.558574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855865.559686:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464229376 00000100:00100000:0.0:1787855865.559711:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464229376 00000100:00100000:0.0:1787855865.559905:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:0.0:1787855865.559920:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:0:x1874702464229376:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787855865.561410:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787855865.601205:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787855865.647537:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:2.0:1787855865.647565:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787855865.647622:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:2.0:1787855865.647681:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787855865.647693:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a73d08aa000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787855865.647709:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a73e746e300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a73d08aa540 00000020:00080000:2.0:1787855865.647713:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a73e746eb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a73f9db9800 00000020:00080000:2.0:1787855865.647903:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787855865.648027:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787855865.648052:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486273152:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787855865.648145:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855865.648239:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486273152 00000100:00100000:2.0:1787855865.648248:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486273152 00000100:00100000:2.0:1787855865.648325:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787855865.648337:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874702486273152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787855865.648372:0:8077:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787855865.648416:0:8077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9083f6, atime: 0x6a9083f6, ctime: 0x6a9083f6, blocks: 0x1 00010000:00010000:2.0:1787855865.648426:0:8077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cb3b7a3/0x516929ca3366db7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855865.648445:0:8077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=356s v=(0 0) 00010000:00010000:2.0:1787855865.648460:0:8077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855865.648468:0:8077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cb3b7a3/0x516929ca3366db7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855865.648505:0:8077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cb3b7a3/0x516929ca3366db7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855865.648517:0:8077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cb3b7a3/0x516929ca3366db7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855865.648525:0:8077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cb3b7a3/0x516929ca3366db7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855865.648547:0:8077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787855865.649146:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1874702486273152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 808us (998us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787855865.649157:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787855865.649190:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787855865.649205:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855865.649213:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cb3b7a3/0x516929ca3366db7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855865.649223:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402046000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:2.0:1787855865.649228:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cb3b7a3/0x516929ca3366db7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855865.649238:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cb3b7a3/0x516929ca3366db7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855865.649272:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cb3b7a3/0x516929ca3366db7e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855865.649280:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cb3b7a3/0x516929ca3366db7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855865.649303:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855865.649305:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855865.649307:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787855865.649352:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a74006ede00/2, rc 0, transno 4294967301 00000100:00100000:2.0:1787855865.649359:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486273152:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1787855865.680542:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1787855865.680581:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6933b672-fa85-4aae-9dc8-092c3f355bbf 00000100:00100000:0.0:1787855865.681134:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:0:x1874702464229376:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 121208us (122791us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787855865.681149:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:0.0:1787855865.689487:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855865.691505:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464229632 00000100:00100000:3.0:1787855865.691532:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464229632 00000100:00100000:2.0:1787855865.691669:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:2.0:1787855865.691682:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:10446:x1874702464229632:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787855865.692066:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:10446:x1874702464229632:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 385us (2597us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787855865.692076:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:2.0:1787855865.733260:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855865.733507:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464229888 00000100:00100000:3.0:1787855865.733521:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464229888 00000100:00100000:3.0:1787855865.733605:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 77 00000100:00100000:3.0:1787855865.733620:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:10446:x1874702464229888:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787855865.734000:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:10446:x1874702464229888:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 382us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855865.734009:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 77 00000100:00100000:3.0:1787855865.740241:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855865.740652:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464230016 00000100:00100000:1.0:1787855865.740666:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464230016 00000100:00100000:1.0:1787855865.740757:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:1.0:1787855865.740770:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:10446:x1874702464230016:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787855865.741276:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855865.741309:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366db85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616bda expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855865.741958:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366db8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855865.741982:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366db8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855865.742005:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366db8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855865.742064:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787855865.742094:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366db8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855865.742142:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366db85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bda expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855865.742165:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366db8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bda expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855865.742175:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a73d40ac300) 00010000:00010000:1.0:1787855865.742178:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787855865.742183:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe800, rc 0) 00000100:00100000:1.0:1787855865.742282:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:10446:x1874702464230016:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1514us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855865.742295:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:1.0:1787855865.752552:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855865.752821:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464230144 00000100:00100000:3.0:1787855865.752834:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464230144 00000100:00100000:3.0:1787855865.752916:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:3.0:1787855865.752929:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464230144:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787855865.752954:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855865.752982:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b634f69c/0x516929ca3366db93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616be1 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787855865.753014:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9083f9, blocks: 0x1 00010000:00010000:3.0:1787855865.753039:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1787855865.753045:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855865.753056:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634f69c/0x516929ca3366db93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be1 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.753079:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b634f69c/0x516929ca3366db93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be1 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.753119:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229200, rc 0) 00000100:00100000:3.0:1787855865.753196:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006e92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464230144:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 270us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855865.753204:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:2.0:1787855865.767460:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855865.767636:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464230400 00000100:00100000:3.0:1787855865.767650:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464230400 00000100:00100000:3.0:1787855865.767741:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:3.0:1787855865.767755:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:10446:x1874702464230400:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787855865.768316:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:10446:x1874702464230400:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 562us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855865.768326:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:3.0:1787855865.774843:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855865.776630:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464230528 00000100:00100000:0.0:1787855865.776647:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464230528 00000100:00100000:0.0:1787855865.777187:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:0.0:1787855865.777201:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:10446:x1874702464230528:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787855865.777225:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855865.777251:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366db9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616be8 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.777291:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b634f69c/0x516929ca3366db93 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be1 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.777303:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787855865.777324:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787855865.777331:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366db9a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be8 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.777376:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b634f69c/0x516929ca3366db93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be1 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855865.777394:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b634f69c/0x516929ca3366db93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be1 expref: 7 pid: 6681 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855865.777411:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa6f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1874702486273280:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787855865.777556:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c4529300 going to sleep for 11 seconds 00000100:00100000:3.0:1787855865.788693:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855865.788752:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464230656 00000100:00100000:3.0:1787855865.788763:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464230656 00010000:00010000:3.0:1787855865.788828:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b634f69c/0x516929ca3366db93 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be1 expref: 8 pid: 6681 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855865.788876:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:3.0:1787855865.788886:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c53d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2358:x1874702464230656:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787855865.788903:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787855865.789209:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa6f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1874702486273280:192.168.201.38@tcp:104: 00010000:00010000:2.0:1787855865.789252:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366db9a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be8 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855865.789274:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143400, rc 0) 00000100:00100000:2.0:1787855865.789371:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:10446:x1874702464230528:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 12172us (14542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855865.789380:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00010000:00010000:3.0:1787855865.789893:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b634f69c/0x516929ca3366db93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be1 expref: 7 pid: 6681 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.791144:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b634f69c/0x516929ca3366db93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be1 expref: 7 pid: 6681 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.791174:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b634f69c/0x516929ca3366db93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be1 expref: 7 pid: 6681 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.791194:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855865.791200:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855865.791210:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366db9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be8 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.791222:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366db9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be8 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855865.791278:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366db9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be8 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855865.791299:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74be580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1874702486273408:192.168.201.38@tcp:105: 00000100:00100000:3.0:1787855865.792339:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9acb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787855865.800122:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855865.802733:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464230784 00000100:00100000:1.0:1787855865.802752:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464230784 00002000:00100000:1.0:1787855865.802848:0:6686:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9a73e74bda40 x1874702464230784/t0(0) o4->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:21/0 lens 504/0 e 0 to 0 dl 1787855876 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787855865.802862:0:6686:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73e74bda40 with x1874702464230784 ext(0->8) 00002000:00010000:1.0:1787855865.802870:0:6686:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a73e74bda40 00000100:00100000:1.0:1787855865.802914:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1787855865.802933:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2358:x1874702464230784:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787855865.805207:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2358:x1874702464230784:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 Request processed in 2267us (5092us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787855865.805220:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00002000:00100000:1.0:1787855865.805231:0:6686:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9a73e74bda40 x1874702464230784/t4294967302(0) o4->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:21/0 lens 504/448 e 0 to 0 dl 1787855876 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787855865.805323:0:6686:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73e74bda40 with x1874702464230784 ext(0->8) 00002000:00010000:1.0:1787855865.805330:0:6686:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a73e74bda40 00000100:00100000:0.0:1787855865.806339:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74be580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1874702486273408:192.168.201.38@tcp:105: 00010000:00010000:0.0:1787855865.806377:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855865.806457:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c53d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2358:x1874702464230656:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 17561us (17767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855865.806470:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:0.0:1787855865.844063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855865.847422:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464230912 00000100:00100000:2.0:1787855865.847471:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464230912 00000100:00100000:2.0:1787855865.847569:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:2.0:1787855865.847583:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:10446:x1874702464230912:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787855865.963221:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:10446:x1874702464230912:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 Request processed in 115618us (119150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855865.963373:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 80 00000001:00080000:1.0:1787855865.963423:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1787855865.963437:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1787855865.963523:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787855865.963749:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787855865.963765:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787855865.969400:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855865.969880:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787855865.969905:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa6f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486273536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787855865.969989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855865.972149:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464231040 00000100:00100000:1.0:1787855865.972171:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464231040 00000100:00100000:3.0:1787855865.972253:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486273536 00000100:00100000:3.0:1787855865.972261:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486273536 00000100:00100000:1.0:1787855865.972276:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:1.0:1787855865.972290:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2358:x1874702464231040:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787855865.972319:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787855865.972330:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486273536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787855865.972591:0:8077:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787855865.972596:0:8077:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787855866 00002000:00010000:3.0:1787855865.972598:0:8077:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787855865.972600:0:8077:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787855865 -> 1787855866 00002000:00010000:3.0:1787855865.972603:0:8077:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787855865.972715:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874702486273536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 388us (2725us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787855865.972725:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787855865.972759:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787855865.972767:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a73fa6f5a40/2, rc 0, transno 4294967303 00000100:00100000:0.0:1787855865.972812:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa6f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486273536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787855866.056398:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2358:x1874702464231040:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 Request processed in 84103us (87009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855866.056412:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 29 00000001:00080000:1.0:1787855866.056470:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1787855866.056486:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1787855866.067218:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855866.068267:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464231296 00000100:00100000:3.0:1787855866.068279:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464231296 00000100:00100000:3.0:1787855866.068362:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:3.0:1787855866.068373:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:10446:x1874702464231296:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787855866.068427:0:9629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855866.068468:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366db8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bda expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.068491:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a73d40ac300) 00010000:00010000:3.0:1787855866.068497:0:9629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787855866.068534:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dba1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.068548:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.068558:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787855866.068855:0:9629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ebc5d58 reply state 00000000b40fbf1d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855866.068877:0:9629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:0.0:1787855866.069583:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855866.070288:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:10446:x1874702464231296:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 1911us (3074us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787855866.070298:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:3.0:1787855866.085914:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855866.085964:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464231424 00000100:00100000:3.0:1787855866.085974:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464231424 00000100:00100000:3.0:1787855866.086026:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:3.0:1787855866.086037:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464231424:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787855866.086317:0:8077:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787855866.086321:0:8077:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787855866 -> 1787855864 00002000:00010000:3.0:1787855866.086323:0:8077:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787855862 00002000:00010000:3.0:1787855866.086325:0:8077:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787855866 -> 1787855864 00002000:00010000:3.0:1787855866.086328:0:8077:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1787855866.086457:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.086468:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dba1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.086476:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dba1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.086482:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855866.086487:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dba1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.086495:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dba1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.086512:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a73d40ac300) 00010000:00010000:2.0:1787855866.086515:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855866.086520:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dba1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.086526:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dba1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855866.101557:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2357:x1874702464231424:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 15503us (15636us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787855866.101574:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 31 00000040:00080000:2.0:1787855866.104661:0:11991:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787855866.104672:0:11991:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787855866.104715:0:11991:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787855866.104722:0:11991:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787855866.105063:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855866.105242:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464231680 00000100:00100000:0.0:1787855866.105257:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464231680 00000100:00100000:0.0:1787855866.105307:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:0.0:1787855866.105317:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:10446:x1874702464231680:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787855866.105390:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dba8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.105408:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366db62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bcc expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.105418:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dba8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.105468:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366db62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bcc expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.105483:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366db62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bcc expref: 13 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855866.105498:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa6f5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874702486273664:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787855866.105593:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c56c59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855866.126850:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa6f5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874702486273664:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855866.126880:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dba8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855866.141090:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855866.142023:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464231808 00000100:00100000:3.0:1787855866.142034:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464231808 00010000:00010000:3.0:1787855866.142082:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366db62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bcc expref: 14 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855866.142126:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:3.0:1787855866.142137:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:2358:x1874702464231808:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787855866.142165:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855866.142172:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366db62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bcc expref: 14 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.142186:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366db62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bcc expref: 14 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.142208:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366db62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bcc expref: 14 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.142222:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a73d40ac300) 00010000:00010000:3.0:1787855866.142227:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dba8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.142235:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.142243:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dba8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.142264:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855866.142321:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:2358:x1874702464231808:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 186us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855866.142329:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00010000:00010000:0.0:1787855866.143318:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.143331:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.145158:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dba8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.145173:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dba8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.145180:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dba8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.145186:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855866.145191:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dba8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.145199:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dba8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.145216:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a73d40ac300) 00010000:00010000:0.0:1787855866.145219:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787855866.145224:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dba8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.145231:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dba8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855866.145324:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+12:10446:x1874702464231680:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 Request processed in 40005us (40262us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787855866.145335:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:1.0:1787855866.165162:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855866.165822:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464231936 00000100:00100000:1.0:1787855866.165845:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464231936 00000100:00100000:1.0:1787855866.165906:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:1.0:1787855866.165916:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2357:x1874702464231936:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787855866.165977:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e7b56acd/0x516929ca3366dbaf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855866.165996:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366db9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be8 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855866.166004:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787855866.166008:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787855866.166013:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b56acd/0x516929ca3366dbaf lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855866.166047:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366db9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be8 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855866.166061:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366db9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be8 expref: 7 pid: 6680 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855866.166075:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006ebc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1874702486273792:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855866.166152:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787855866.169869:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855866.169942:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006ebc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1874702486273792:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855866.169972:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e7b56acd/0x516929ca3366dbaf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855866.176097:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464232064 00000100:00100000:3.0:1787855866.176113:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464232064 00010000:00010000:3.0:1787855866.176160:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366db9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be8 expref: 8 pid: 6680 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855866.176229:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:3.0:1787855866.176239:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2357:x1874702464232064:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787855866.176256:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855866.176279:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366db9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be8 expref: 8 pid: 6680 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.176293:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366db9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be8 expref: 8 pid: 6680 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.176318:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039ca6585/0x516929ca3366db9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616be8 expref: 8 pid: 6680 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.176336:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787855866.176340:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787855866.176345:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7b56acd/0x516929ca3366dbaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.176356:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b56acd/0x516929ca3366dbaf lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.176384:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855866.176455:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ead00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2357:x1874702464232064:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 217us (6594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855866.176462:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 44 00010000:00010000:3.0:1787855866.176591:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e7b56acd/0x516929ca3366dbaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.176600:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7b56acd/0x516929ca3366dbaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.176622:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e7b56acd/0x516929ca3366dbaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.176629:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b56acd/0x516929ca3366dbaf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.176636:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7b56acd/0x516929ca3366dbaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.176643:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe600 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787855866.176647:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7b56acd/0x516929ca3366dbaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.176657:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7b56acd/0x516929ca3366dbaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.176668:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7b56acd/0x516929ca3366dbaf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.176676:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7b56acd/0x516929ca3366dbaf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855866.176740:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464231936:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 Request processed in 10824us (11587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855866.176748:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:3.0:1787855866.191712:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855866.192166:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464232320 00000100:00100000:0.0:1787855866.192186:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464232320 00000100:00100000:0.0:1787855866.192247:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 83 00000100:00100000:0.0:1787855866.192267:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+12:10446:x1874702464232320:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787855866.192344:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dbb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.192364:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dbb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.192376:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dbb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.193185:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dbbd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.193204:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bd3 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.193213:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dbbd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.193249:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bd3 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.193264:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bd3 expref: 13 pid: 5835 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855866.193279:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa6f5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486273920:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787855866.193371:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c56c59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787855866.196542:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855866.196649:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464232448 00000100:00100000:2.0:1787855866.196658:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464232448 00010000:00010000:2.0:1787855866.196705:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db70 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bd3 expref: 14 pid: 5835 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855866.196751:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:2.0:1787855866.196760:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74be580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:2357:x1874702464232448:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855866.196797:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855866.196805:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db70 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bd3 expref: 14 pid: 5835 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.196818:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bd3 expref: 14 pid: 5835 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.196839:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a73d40ac300) 00010000:00010000:2.0:1787855866.196844:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dbbd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.196853:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dbbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.196861:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dbbd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.196894:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855866.196946:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74be580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:2357:x1874702464232448:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 187us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855866.196954:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 45 00010000:00010000:0.0:1787855866.197399:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366db70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bd3 expref: 13 pid: 5835 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855866.197435:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa6f5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486273920:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855866.197468:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dbbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.197477:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dbbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855866.197484:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dbbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787855866.197711:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1787855866.198089:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787855866.198140:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1787855866.198288:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa6f5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874702486274048:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787855866.198345:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855866.198425:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c3307e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787855866.207334:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486274048 00000100:00100000:3.0:1787855866.207350:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486274048 00000100:00100000:2.0:1787855866.207997:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787855866.208007:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874702486274048:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787855866.208133:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874702486274048:12345-0@lo:1000:mdt00_000.0 Request processed in 127us (9787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855866.208141:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787855866.208256:0:5833:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787855866.208262:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a73fa6f5a40, transno 4294967303 00000100:00100000:2.0:1787855866.208278:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa6f5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874702486274048:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787855866.211445:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787855866.213675:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006ec3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874702486274176:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787855866.213750:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855866.213801:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73f9d52180 going to sleep for 11 seconds 00000100:00100000:2.0:1787855866.214218:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486274176 00000100:00100000:2.0:1787855866.214226:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486274176 00000100:00100000:2.0:1787855866.214268:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787855866.214276:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874702486274176:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787855866.214477:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1874702486274176:12345-0@lo:1000:mdt00_000.0 Request processed in 201us (726us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787855866.214486:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787855866.214534:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006ec3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874702486274176:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787855866.214578:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dbbd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.214598:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dbbd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.215852:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dbbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.215864:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855866.215868:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dbbd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.215876:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dbbd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.215892:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a73d40ac300) 00010000:00010000:2.0:1787855866.215895:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787855866.215899:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dbbd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.215905:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dbbd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.215948:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366daeb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.215953:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366daeb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.215960:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366daeb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.215964:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855866.215978:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366daeb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.215984:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366daeb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.215992:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73d40ac500) 00010000:00010000:2.0:1787855866.215995:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787855866.215998:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366daeb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.216003:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366daeb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.216025:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dbc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.216040:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366db07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bb7 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.216049:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dbc4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.216088:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366db07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bb7 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.216104:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366db07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bb7 expref: 16 pid: 5833 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855866.216119:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006eed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486274304:192.168.201.38@tcp:104: 00000100:00100000:2.0:1787855866.218847:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c11cac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787855866.225869:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006eed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486274304:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787855866.225901:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dbc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855866.228520:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855866.235208:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464232576 00000100:00100000:3.0:1787855866.235223:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464232576 00010000:00010000:3.0:1787855866.235269:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366db07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bb7 expref: 17 pid: 5833 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855866.235350:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:3.0:1787855866.235361:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+17:2358:x1874702464232576:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787855866.235375:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855866.235383:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366db07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bb7 expref: 17 pid: 5833 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.235397:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366db07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bb7 expref: 17 pid: 5833 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.235421:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366db07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bb7 expref: 17 pid: 5833 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.235455:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73d40ac500) 00010000:00010000:3.0:1787855866.235463:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dbc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.235473:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dbc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.235482:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dbc4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855866.235513:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787855866.235812:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dbc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.235821:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dbc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.235833:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dbc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.235838:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dbc4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.235845:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dbc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.235850:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402047400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855866.235855:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dbc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.235862:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dbc4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.235872:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73d40ac500) 00010000:00010000:2.0:1787855866.235875:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855866.235879:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dbc4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.235886:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dbc4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.235898:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dbb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.235914:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dbb6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.235920:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dbb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.235925:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855866.235928:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dbb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.235934:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dbb6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.235942:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73d40ac500) 00010000:00010000:2.0:1787855866.235945:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787855866.235947:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dbb6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.235953:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dbb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855866.236241:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+16:10446:x1874702464232320:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 43973us (44537us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787855866.236252:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 83 00000020:00080000:2.0:1787855866.236258:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787855866.236370:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787855866.236374:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787855866.236417:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787855866.236423:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787855866.236720:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:2358:x1874702464232576:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1357us (8207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855866.236729:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:3.0:1787855866.239498:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855866.239976:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464232832 00000100:00100000:2.0:1787855866.239999:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464232832 00000100:00100000:2.0:1787855866.240735:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:2.0:1787855866.240748:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:10446:x1874702464232832:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787855866.241480:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787855866.241605:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787855866.242416:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dbcb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.242444:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dbcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.242457:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dbcb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.242466:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dbcb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.242473:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dbcb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.242479:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dbcb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855866.242505:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787855866.242619:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+17:10446:x1874702464232832:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 1862us (3119us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787855866.242629:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000020:00080000:2.0:1787855866.242635:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787855866.242684:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787855866.242691:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dbcb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855866.242698:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402046000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787855866.242702:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dbcb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855866.242709:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dbcb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855866.242721:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a73c7093d00) 00010000:00010000:1.0:1787855866.242724:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787855866.242728:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dbcb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855866.242734:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dbcb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855866.242749:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855866.242751:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855866.242753:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855866.627063:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855867.644188:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855868.041645:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787855868.041681:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486274432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855868.041798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855868.041888:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486274432 00000100:00100000:3.0:1787855868.041898:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486274432 00000100:00100000:3.0:1787855868.041969:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787855868.041981:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc254b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874702486274432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787855868.042027:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855868.042079:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc254b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874702486274432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855868.042087:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787855868.042160:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486274432:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787855868.042639:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787855868.187271:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1787855868.187560:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1787855868.326167:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855868.326219:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855868.326254:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855868.326279:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855868.326306:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855868.326341:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464233472 00000100:00100000:0.0:1787855868.326353:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464233472 00000100:00100000:0.0:1787855868.326432:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464233088 00000100:00100000:0.0:1787855868.326440:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464233088 00000100:00100000:0.0:1787855868.326480:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 138 00000100:00100000:0.0:1787855868.326491:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2358:x1874702464233472:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855868.326537:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464232960 00000100:00100000:1.0:1787855868.326543:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464232960 00000100:00100000:0.0:1787855868.326592:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2358:x1874702464233472:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 102us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855868.326601:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 138 00000100:00100000:0.0:1787855868.326620:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 139 00000100:00100000:3.0:1787855868.326714:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464233216 00000100:00100000:3.0:1787855868.326719:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464233216 00000100:00100000:3.0:1787855868.326755:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464233344 00000100:00100000:3.0:1787855868.326758:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464233344 00000100:00100000:3.0:1787855868.326813:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:3.0:1787855868.326823:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2358:x1874702464233216:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855868.326829:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 287 00000100:00100000:1.0:1787855868.326843:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2358:x1874702464232960:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855868.326860:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2358:x1874702464233216:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 39us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855868.326869:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:1.0:1787855868.326883:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7164050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2358:x1874702464232960:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 43us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855868.326885:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:3.0:1787855868.326895:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2358:x1874702464233344:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855868.326906:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 287 00000100:00100000:3.0:1787855868.326930:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2358:x1874702464233344:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 37us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855868.326937:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00080000:1.0:1787855868.327051:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787855868.327057:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787855868.327061:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855868.327178:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+17:2358:x1874702464233088:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855868.327230:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+17:2358:x1874702464233088:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 602us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855868.327237:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 139 00000040:00080000:1.0:1787855868.394004:0:12043:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787855868.394019:0:12043:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787855868.394065:0:12043:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787855868.394071:0:12043:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787855868.489172:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855868.489262:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464233728 00000100:00100000:1.0:1787855868.489275:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464233728 00000100:00100000:1.0:1787855868.489340:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:1.0:1787855868.489348:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+17:10465:x1874702464233728:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787855868.489371:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855868.489395:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366dbd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616bef expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.489817:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366dbd9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.489833:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366dbd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.489849:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366dbd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855868.489862:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787855868.490061:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366dbd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bef expref: 20 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.490094:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366dbd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bef expref: 19 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.490105:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:1.0:1787855868.490108:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787855868.490112:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fee00, rc 0) 00000100:00100000:1.0:1787855868.490179:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:10465:x1874702464233728:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 831us (1021us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787855868.490186:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:3.0:1787855868.495113:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855868.495164:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464233856 00000100:00100000:3.0:1787855868.495178:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464233856 00000100:00100000:3.0:1787855868.495608:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:3.0:1787855868.495634:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:10465:x1874702464233856:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:3.0:1787855868.495736:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366dbe7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.495757:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366dbe7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.495810:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366dbe7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.495831:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dbee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.495839:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dbee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.495845:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dbee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496154:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dbf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496163:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496169:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787855868.496220:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496233:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366dbe7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496239:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366dbe7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496246:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366dbe7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496259:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855868.496264:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366dbe7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496273:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366dbe7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496287:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:3.0:1787855868.496290:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855868.496295:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366dbe7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496300:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366dbe7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496310:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dbee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496315:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dbee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496320:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dbee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496324:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855868.496326:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dbee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496330:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dbee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496344:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73d40aca00) 00010000:00010000:3.0:1787855868.496346:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855868.496349:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dbee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496354:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dbee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496368:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dbf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496373:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dbf5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496379:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496382:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855868.496384:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dbf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496389:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dbf5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496394:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73d40ace00) 00010000:00010000:3.0:1787855868.496396:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855868.496411:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dbf5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.496416:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dbf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855868.496530:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:10465:x1874702464233856:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 898us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855868.496540:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:0.0:1787855868.524215:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855868.524327:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464234112 00000100:00100000:1.0:1787855868.524341:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464234112 00000100:00100000:1.0:1787855868.524437:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:1.0:1787855868.524449:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c92803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:10468:x1874702464234112:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787855868.524481:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855868.524516:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366dbfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616bf6 expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.524681:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dc03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.524700:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dc03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.524716:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dc03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.524735:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dc0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.524755:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dc0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.524762:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dc0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525145:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366dc11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525155:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366dc11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525161:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366dc11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855868.525173:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787855868.525277:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dc03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525284:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dc03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525292:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dc03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525298:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855868.525302:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dc03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525309:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dc03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525333:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:1.0:1787855868.525336:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855868.525341:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dc03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525348:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dc03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525362:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dc0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525368:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dc0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525374:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dc0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525379:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855868.525382:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dc0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525388:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dc0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525394:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73c8d1dd00) 00010000:00010000:1.0:1787855868.525407:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855868.525411:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dc0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525416:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dc0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525475:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366dbfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bf6 expref: 22 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525490:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366dc11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bf6 expref: 21 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.525497:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c8d1da00) 00010000:00010000:1.0:1787855868.525499:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787855868.525502:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe600, rc 0) 00000100:00100000:1.0:1787855868.525581:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c92803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:10468:x1874702464234112:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1134us (1380us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787855868.525589:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:1.0:1787855868.529375:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855868.529535:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464234240 00000100:00100000:2.0:1787855868.529558:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464234240 00000100:00100000:2.0:1787855868.529686:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 87 00000100:00100000:2.0:1787855868.529709:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:10468:x1874702464234240:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:2.0:1787855868.529838:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.529861:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.529878:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.529915:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.529922:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.529929:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.529936:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402047400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855868.529941:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.529949:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.529963:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c8d1da00) 00010000:00010000:2.0:1787855868.529966:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787855868.529972:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.529978:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855868.530079:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:10468:x1874702464234240:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 374us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855868.530088:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 87 00000100:00100000:3.0:1787855868.532591:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855868.533084:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464234496 00000100:00100000:1.0:1787855868.533097:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464234496 00000100:00100000:1.0:1787855868.533193:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:1.0:1787855868.533205:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73dc260450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:10468:x1874702464234496:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1787855868.533523:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73dc260450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+22:10468:x1874702464234496:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 320us (945us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787855868.533532:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:0.0:1787855868.547180:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486274688:0@lo:400:kworker.0 00000100:00100000:1.0:1787855868.547181:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9731e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486274944:0@lo:400:kworker.0 00000100:00100000:2.0:1787855868.547258:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c92830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486274560:0@lo:400:kworker.0 00000100:00100000:0.0:1787855868.547762:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855868.547914:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9730b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486275200:0@lo:400:kworker.0 00000100:00100000:0.0:1787855868.547948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855868.547986:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787855868.547994:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa0a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486274816:0@lo:400:kworker.0 00000100:00100000:0.0:1787855868.548022:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855868.548108:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486275200 00000100:00100000:0.0:1787855868.548120:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486275200 00000100:00100000:0.0:1787855868.548201:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787855868.548214:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c33552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486275200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855868.548285:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c33552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486275200:12345-0@lo:400:kworker.0 Request processed in 74us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855868.548293:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1787855868.548334:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787855868.548569:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1787855868.548578:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1787855868.548715:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a74006ede00, transno 4294967301 00000100:00100000:0.0:1787855868.548734:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9730b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486275200:0@lo:400:kworker.0 00000100:00100000:1.0:1787855868.549355:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855868.549417:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486274944 00000100:00100000:1.0:1787855868.549423:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486274944 00000100:00100000:1.0:1787855868.549467:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787855868.549485:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874702486274944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855868.549791:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874702486274944:12345-0@lo:400:kworker.0 Request processed in 57us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855868.549802:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787855868.549856:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9731e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486274944:0@lo:400:kworker.0 00000100:00100000:3.0:1787855868.549926:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486274688 00000100:00100000:3.0:1787855868.549933:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486274688 00000100:00100000:2.0:1787855868.549963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855868.549967:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486274816 00000100:00100000:3.0:1787855868.549970:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486274816 00000100:00100000:3.0:1787855868.550002:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787855868.550002:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c97312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486275072:0@lo:400:kworker.0 00000100:00100000:3.0:1787855868.550009:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9731680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486274688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855868.550032:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855868.550050:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9731680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486274688:12345-0@lo:400:kworker.0 Request processed in 41us (2290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855868.550057:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787855868.550061:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486274560 00000100:00100000:2.0:1787855868.550064:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486274560 00000100:00100000:3.0:1787855868.550069:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486275072 00000100:00100000:3.0:1787855868.550071:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486275072 00000100:00100000:3.0:1787855868.550084:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787855868.550090:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486274816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855868.550093:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787855868.550098:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486274560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855868.550120:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486274816:12345-0@lo:400:kworker.0 Request processed in 30us (2098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855868.550126:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787855868.550128:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7164c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486274560:12345-0@lo:400:kworker.0 Request processed in 30us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855868.550133:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787855868.550137:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787855868.550142:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486275072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855868.550167:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486275072:12345-0@lo:400:kworker.0 Request processed in 25us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855868.550167:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c92830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486274560:0@lo:400:kworker.0 00000100:00100000:3.0:1787855868.550173:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787855868.550178:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c97312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486275072:0@lo:400:kworker.0 00000100:00080000:3.0:1787855868.550194:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855868.550229:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486274816:0@lo:400:kworker.0 00000100:00100000:3.0:1787855868.550242:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa0a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486274688:0@lo:400:kworker.0 00000100:00100000:1.0:1787855868.555818:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855868.555996:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464234752 00000100:00100000:3.0:1787855868.556009:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464234752 00000100:00100000:3.0:1787855868.556090:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 88 00000100:00100000:3.0:1787855868.556104:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+22:9986:x1874702464234752:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1787855868.556136:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855868.556163:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dc26 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616bfd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.556303:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dc2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.556321:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366dc11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bf6 expref: 23 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.556332:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dc2d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.556374:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366dc11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bf6 expref: 23 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.556390:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366dc11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bf6 expref: 23 pid: 9629 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855868.556615:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9de7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874702486275328:192.168.201.38@tcp:104: 00000100:00100000:3.0:1787855868.556976:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9ac240 going to sleep for 11 seconds 00000100:00100000:1.0:1787855868.560090:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855868.560171:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9de7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874702486275328:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855868.560203:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dc2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855868.560846:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464234880 00000100:00100000:2.0:1787855868.560855:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464234880 00010000:00010000:2.0:1787855868.560903:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366dc11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bf6 expref: 24 pid: 9629 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855868.560942:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:2.0:1787855868.560952:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+24:2358:x1874702464234880:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855868.560972:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855868.560987:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366dc11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bf6 expref: 24 pid: 9629 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.560998:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366dc11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bf6 expref: 24 pid: 9629 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.561023:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366dc11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bf6 expref: 24 pid: 9629 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.561034:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c8d1da00) 00010000:00010000:2.0:1787855868.561039:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dc2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.561047:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dc2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.561053:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dc2d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.561075:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787855868.561093:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dc2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.561101:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dc2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855868.561126:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:2.0:1787855868.561150:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006e8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+23:2358:x1874702464234880:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 199us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855868.561157:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00010000:00010000:0.0:1787855868.561328:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dc26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bfd expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.561346:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dc2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bfd expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.561355:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c8d1da00) 00010000:00010000:0.0:1787855868.561358:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787855868.561361:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229200, rc 0) 00000100:00100000:0.0:1787855868.561392:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+23:9986:x1874702464234752:12345-192.168.201.38@tcp:101:bash.0 Request processed in 5291us (5628us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787855868.561416:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 88 00000100:00100000:3.0:1787855868.565193:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855868.565294:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464235136 00000100:00100000:0.0:1787855868.565314:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464235136 00000100:00100000:0.0:1787855868.565383:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 89 00000100:00100000:0.0:1787855868.565394:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+23:9986:x1874702464235136:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:0.0:1787855868.565759:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366dc3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.565911:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366dc3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.565925:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366dc3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787855868.565986:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1787855868.566013:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047b081a4 reply state 00000000b6e730d4 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366dc3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855868.566024:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787855868.566071:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1787855868.566189:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+27:9986:x1874702464235136:12345-192.168.201.38@tcp:36:bash.0 Request processed in 794us (1012us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1787855868.566198:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 89 00000020:00080000:0.0:1787855868.566204:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787855868.569354:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00010000:1.0:1787855868.569407:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366dc3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.569421:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366dc3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.569429:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366dc3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.569441:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855868.569446:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366dc3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.569455:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366dc3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.569476:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c8d1da00) 00010000:00010000:1.0:1787855868.569480:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855868.569487:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366dc3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.569495:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366dc3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855868.569546:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464235264 00000100:00100000:1.0:1787855868.569558:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464235264 00000100:00100000:1.0:1787855868.570641:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00100000:1.0:1787855868.570658:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+26:9986:x1874702464235264:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1787855868.570689:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855868.570718:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dc42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c04 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.570809:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dc42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c04 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.570826:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dc42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c04 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.570852:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c8d1da00) 00010000:00010000:1.0:1787855868.570855:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787855868.570858:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ff200, rc 0) 00000100:00100000:1.0:1787855868.570942:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+27:9986:x1874702464235264:12345-192.168.201.38@tcp:101:bash.0 Request processed in 288us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855868.570950:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00100000:3.0:1787855868.573245:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855868.573291:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464235392 00000100:00100000:3.0:1787855868.573304:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464235392 00000100:00100000:3.0:1787855868.573377:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:3.0:1787855868.573391:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:9986:x1874702464235392:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1787855868.573425:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855868.573452:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000520f8d23/0x516929ca3366dc49 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c0b expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787855868.573486:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9083f8, atime: 0x6a9083f6, ctime: 0x6a9083f8, blocks: 0xb 00010000:00010000:3.0:1787855868.574007:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1787855868.574016:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855868.574028:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000520f8d23/0x516929ca3366dc49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c0b expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.574052:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000520f8d23/0x516929ca3366dc49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c0b expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.574068:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228800, rc 0) 00000100:00100000:3.0:1787855868.574191:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:9986:x1874702464235392:12345-192.168.201.38@tcp:101:bash.0 Request processed in 803us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855868.574200:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:1.0:1787855868.576812:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855868.577167:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464235520 00000100:00100000:3.0:1787855868.577180:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464235520 00002000:00010000:3.0:1787855868.577237:0:6684:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1787855868.577243:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a74006ea580 with x1874702464235520 ext(0->18446744073709551615) 00002000:00010000:3.0:1787855868.577265:0:6684:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a74006ea580. 00000100:00100000:3.0:1787855868.577301:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:3.0:1787855868.577314:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2360:x1874702464235520:12345-192.168.201.38@tcp:10:bash.0 00002000:00010000:3.0:1787855868.578020:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787855868.578025:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787855864 -> 1787855869 00002000:00010000:3.0:1787855868.578027:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787855862 -> 1787855862 00002000:00010000:3.0:1787855868.578030:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787855864 -> 1787855869 00002000:00010000:3.0:1787855868.578032:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787855868.578156:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2360:x1874702464235520:12345-192.168.201.38@tcp:10:bash.0 Request processed in 842us (1357us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787855868.578167:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00002000:00010000:3.0:1787855868.578172:0:6684:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1787855868.578175:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a74006ea580 with x1874702464235520 ext(0->18446744073709551615) 00002000:00010000:3.0:1787855868.578181:0:6684:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a74006ea580. 00000100:00100000:2.0:1787855868.629688:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855868.629915:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464235648 00000100:00100000:1.0:1787855868.629928:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464235648 00000100:00100000:1.0:1787855868.630017:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 91 00000100:00100000:1.0:1787855868.630033:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+27:10482:x1874702464235648:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:1.0:1787855868.630139:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc50 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630177:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630192:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630233:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630241:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630248:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630585:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366dc5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630595:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366dc5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630603:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366dc5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787855868.630866:0:9629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366dc5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630880:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630886:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc50 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630904:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630911:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855868.630916:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630924:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc50 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630937:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:1.0:1787855868.630939:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855868.630944:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630949:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630962:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630968:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630974:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.630978:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855868.630981:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.631045:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.631054:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73c8d1dd00) 00010000:00010000:1.0:1787855868.631056:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855868.631059:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.631065:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.631081:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366dc5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.631086:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366dc5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.631090:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366dc5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.631092:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855868.631094:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366dc5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.631097:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366dc5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.631101:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c8d1da00) 00010000:00010000:1.0:1787855868.631102:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855868.631104:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366dc5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.631115:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366dc5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855868.631297:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+27:10482:x1874702464235648:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 1267us (1621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855868.631306:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 91 00000100:00100000:2.0:1787855868.662750:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855868.662966:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464235904 00000100:00100000:1.0:1787855868.662986:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464235904 00000100:00100000:1.0:1787855868.663272:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 92 00000100:00100000:1.0:1787855868.663286:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+27:10485:x1874702464235904:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787855868.663320:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855868.663355:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366dc65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c12 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.663483:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.663502:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.663515:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.663532:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.663539:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.663575:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664057:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366dc7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664068:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366dc7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664077:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366dc7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855868.664087:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787855868.664211:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664220:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664228:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664235:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855868.664240:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664249:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664264:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:1.0:1787855868.664268:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855868.664281:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664288:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dc6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664304:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664311:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664318:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664323:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855868.664327:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664334:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664342:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73c8d1dd00) 00010000:00010000:1.0:1787855868.664345:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855868.664348:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664354:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dc73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664414:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366dc65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c12 expref: 30 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664444:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366dc7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c12 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.664452:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c8d1da00) 00010000:00010000:1.0:1787855868.664455:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787855868.664457:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe000, rc 0) 00000100:00100000:1.0:1787855868.664557:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+29:10485:x1874702464235904:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1274us (1825us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787855868.664567:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 92 00000100:00100000:3.0:1787855868.668079:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855868.668258:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464236032 00000100:00100000:0.0:1787855868.668272:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464236032 00000100:00100000:0.0:1787855868.668344:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 93 00000100:00100000:0.0:1787855868.668357:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+29:10485:x1874702464236032:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:0.0:1787855868.668461:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dc88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.668482:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dc2d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bfd expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.668514:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dc88 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855868.669331:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855868.669440:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dc2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bfd expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.669463:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dc2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bfd expref: 29 pid: 5835 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855868.669486:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874702486275456:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787855868.670168:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855868.674113:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874702486275456:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855868.674155:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dc88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855868.675645:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855868.675936:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464236288 00000100:00100000:2.0:1787855868.675948:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464236288 00000100:00100000:2.0:1787855868.676019:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:2.0:1787855868.676028:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+30:5596:x1874702464236288:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787855868.676848:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+31:5596:x1874702464236288:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 815us (1209us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787855868.676873:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:2.0:1787855868.688859:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855868.688975:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464236416 00000100:00100000:0.0:1787855868.688989:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464236416 00010000:00010000:0.0:1787855868.689047:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dc2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bfd expref: 31 pid: 5835 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855868.689100:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:0.0:1787855868.689124:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+31:2358:x1874702464236416:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855868.689145:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855868.689151:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dc2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bfd expref: 31 pid: 5835 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.689189:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dc2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bfd expref: 31 pid: 5835 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.689216:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366dc2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bfd expref: 31 pid: 5835 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.689250:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c8d1da00) 00010000:00010000:0.0:1787855868.689257:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dc88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.689269:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dc88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.689278:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dc88 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.689323:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855868.689409:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+30:2358:x1874702464236416:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 287us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855868.689417:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 48 00010000:00010000:1.0:1787855868.689957:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dc88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.689970:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dc88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.690014:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dc88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.690022:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dc88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.690028:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dc88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.690035:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855868.690040:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dc88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.690050:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dc88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.690074:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c8d1da00) 00010000:00010000:1.0:1787855868.690077:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787855868.690082:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dc88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.690090:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dc88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855868.690221:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+29:10485:x1874702464236032:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 21865us (22172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855868.690915:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 93 00000100:00100000:2.0:1787855868.695419:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855868.695643:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464236672 00000100:00100000:3.0:1787855868.695656:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464236672 00000100:00100000:3.0:1787855868.695770:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:3.0:1787855868.695803:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+29:10485:x1874702464236672:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1787855868.696125:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+30:10485:x1874702464236672:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 323us (731us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787855868.696133:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:0.0:1787855868.825458:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855868.825620:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464236928 00000100:00100000:1.0:1787855868.825635:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464236928 00000100:00100000:2.0:1787855868.825850:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00100000:2.0:1787855868.825867:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+30:10496:x1874702464236928:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:2.0:1787855868.825899:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855868.825926:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366dc8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c19 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826020:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dc96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826039:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dc96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826053:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dc96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826071:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826078:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826084:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826530:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886600/0x516929ca3366dca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826551:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886600/0x516929ca3366dca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826559:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886600/0x516929ca3366dca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855868.826571:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787855868.826695:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dc96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826716:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dc96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826726:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dc96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826733:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402046000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855868.826739:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dc96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826748:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dc96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826765:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:2.0:1787855868.826769:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855868.826826:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dc96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826845:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046000/0x516929ca3366dc96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826860:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826866:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826872:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826877:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402047400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855868.826881:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826887:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826897:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73c7093400) 00010000:00010000:2.0:1787855868.826900:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855868.826904:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826910:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047400/0x516929ca3366dc9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826962:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402047800/0x516929ca3366dc8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c19 expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826977:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886600/0x516929ca3366dca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c19 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.826992:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c8d1da00) 00010000:00010000:2.0:1787855868.826995:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787855868.826997:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7886600, rc 0) 00000100:00100000:2.0:1787855868.827092:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+32:10496:x1874702464236928:12345-192.168.201.38@tcp:101:cat.0 Request processed in 1230us (1650us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787855868.827103:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00100000:2.0:1787855868.830920:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855868.832719:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464237184 00000100:00100000:1.0:1787855868.832735:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464237184 00000100:00100000:1.0:1787855868.833251:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:1.0:1787855868.833265:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+32:10496:x1874702464237184:12345-192.168.201.38@tcp:35:cat.0 00000100:00100000:1.0:1787855868.833693:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+33:10496:x1874702464237184:12345-192.168.201.38@tcp:35:cat.0 Request processed in 429us (2783us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787855868.833703:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:3.0:1787855868.866761:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855868.868422:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464237440 00000100:00100000:2.0:1787855868.868440:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464237440 00000100:00100000:2.0:1787855868.869315:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 95 00000100:00100000:2.0:1787855868.869332:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df8043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+33:10497:x1874702464237440:12345-192.168.201.38@tcp:36:rm.0 00010000:00010000:2.0:1787855868.869423:0:9629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787855868.869461:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886600/0x516929ca3366dca4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c19 expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.869481:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366dc7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c12 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.869493:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dc42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c04 expref: 31 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.869504:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c8d1da00) 00010000:00010000:2.0:1787855868.869517:0:9629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787855868.869557:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366dcb2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.869588:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366dcb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.869601:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366dcb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.869630:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366dcb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.869639:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366dcb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.869646:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366dcb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.870008:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366dcc0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.870017:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366dcc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.870025:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366dcc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787855868.872883:0:9629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1787855868.872897:0:9629:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359725120300ns, next at 360725117320ns, rc = 0 00010000:00010000:2.0:1787855868.872974:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366dcc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.872990:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366dcc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873014:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366dcc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873024:0:9629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366dcc7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873032:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366dcc7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873039:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366dcc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873065:0:9629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787855868.873092:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855868.873097:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366dcc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.873101:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366dcc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873114:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366dcc0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873121:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366dcc0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.873122:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887600 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:2.0:1787855868.873126:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855868.873127:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366dcc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873129:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366dcc0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873137:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366dcc0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.873219:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366dcc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.873233:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093600) 00010000:00010000:1.0:1787855868.873236:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787855868.873243:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366dcc7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.873249:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366dcc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.873266:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855868.873268:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855868.873270:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855868.873389:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a73c7093600) 00010000:00010000:2.0:1787855868.873400:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787855868.873411:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366dcc0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873422:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366dcc0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873493:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366dcb2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873500:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366dcb2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873506:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366dcb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873510:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855868.873512:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366dcb2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873517:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366dcb2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873523:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:2.0:1787855868.873524:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855868.873527:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366dcb2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.873530:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366dcb2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787855868.873538:0:9629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df412190 reply state 00000000a69d03b2 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366dcb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855868.873560:0:9629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787855868.873906:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df8043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+32:10497:x1874702464237440:12345-192.168.201.38@tcp:36:rm.0 Request processed in 4573us (7154us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787855868.873916:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 95 00010000:00010000:2.0:1787855868.876178:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366dcb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.876265:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366dcb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.876274:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366dcb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.876282:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855868.876289:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366dcb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.876298:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366dcb9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.876322:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73c7093400) 00010000:00010000:2.0:1787855868.876326:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855868.876332:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366dcb9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.876340:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366dcb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855868.915768:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855868.916009:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464237696 00000100:00100000:1.0:1787855868.916022:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464237696 00000100:00100000:1.0:1787855868.916099:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 96 00000100:00100000:1.0:1787855868.916112:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df807c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+31:10503:x1874702464237696:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1787855868.916145:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855868.916174:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366dcce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c20 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.916342:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dcd5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.916361:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dcd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.916376:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dcd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.916429:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dcdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.916438:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dcdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.916446:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dcdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787855868.917468:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787855868.918432:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dce3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.918451:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.918464:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.918888:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dcd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.918899:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dcd5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.918906:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dcd5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.918913:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855868.918917:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dcd5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.918943:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dcd5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.918958:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:1.0:1787855868.918962:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855868.918968:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dcd5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.918975:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366dcd5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787855868.919059:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1e29b19 reply state 00000000343054e5 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dcdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855868.919071:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787855868.919119:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366dcce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c20 expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.919137:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c20 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.919145:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1d200) 00010000:00010000:1.0:1787855868.919148:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787855868.919150:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ff200, rc 0) 00000100:00100000:1.0:1787855868.919316:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df807c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+34:10503:x1874702464237696:12345-192.168.201.38@tcp:101:bash.0 Request processed in 3205us (3564us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787855868.919327:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 96 00000100:00100000:3.0:1787855868.925496:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00010000:1.0:1787855868.925626:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dcdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.925675:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dcdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.925684:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dcdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.925691:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855868.925697:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dcdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.925707:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dcdc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.925731:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73c8d1dd00) 00010000:00010000:1.0:1787855868.925735:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855868.925741:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dcdc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.925748:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366dcdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855868.926958:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464237824 00000100:00100000:2.0:1787855868.926976:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464237824 00000100:00100000:2.0:1787855868.927259:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:2.0:1787855868.927274:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df806d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464237824:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1787855868.927299:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855868.927339:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005700afa4/0x516929ca3366dcf1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c27 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787855868.927377:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855868.927412:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:2.0:1787855868.927418:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855868.927430:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005700afa4/0x516929ca3366dcf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c27 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.927454:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005700afa4/0x516929ca3366dcf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c27 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855868.927471:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7886800, rc 0) 00000100:00100000:2.0:1787855868.927582:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df806d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464237824:12345-192.168.201.38@tcp:101:bash.0 Request processed in 311us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855868.927590:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:0.0:1787855868.931037:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855868.931911:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464237952 00000100:00100000:1.0:1787855868.931924:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464237952 00000100:00100000:1.0:1787855868.932047:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:1.0:1787855868.932060:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:10503:x1874702464237952:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1787855868.932085:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855868.932108:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c2e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.932172:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005700afa4/0x516929ca3366dcf1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c27 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.932183:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787855868.932187:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787855868.932194:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c2e expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.932239:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005700afa4/0x516929ca3366dcf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c27 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.932256:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005700afa4/0x516929ca3366dcf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c27 expref: 7 pid: 6681 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855868.932274:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006e9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6679:1874702486275584:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855868.932408:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73f4996f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787855868.936428:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855868.936596:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006e9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6679:1874702486275584:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855868.936661:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c2e expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855868.936695:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ff400, rc 0) 00000100:00100000:1.0:1787855868.936802:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:10503:x1874702464237952:12345-192.168.201.38@tcp:101:bash.0 Request processed in 4720us (5756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855868.936813:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:0.0:1787855868.939063:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464238080 00000100:00100000:0.0:1787855868.939085:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464238080 00010000:00010000:0.0:1787855868.939146:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005700afa4/0x516929ca3366dcf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c27 expref: 7 pid: 6681 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855868.939252:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:0.0:1787855868.939280:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c53d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2358:x1874702464238080:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855868.939302:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855868.939335:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005700afa4/0x516929ca3366dcf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c27 expref: 7 pid: 6681 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.939351:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005700afa4/0x516929ca3366dcf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c27 expref: 7 pid: 6681 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.939384:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005700afa4/0x516929ca3366dcf1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c27 expref: 7 pid: 6681 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.939415:0:7616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787855868.939420:0:7616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787855868.939431:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c2e expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.939446:0:7616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c2e expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855868.939502:0:7616:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c2e expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855868.939520:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c97312c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7616:1874702486275712:192.168.201.38@tcp:105: 00000100:00100000:0.0:1787855868.939981:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855868.943632:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855868.943829:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464238336 00000100:00100000:3.0:1787855868.943841:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464238336 00000100:00100000:3.0:1787855868.943891:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:3.0:1787855868.943899:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+33:10503:x1874702464238336:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:3.0:1787855868.944447:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+34:10503:x1874702464238336:12345-192.168.201.38@tcp:35:bash.0 Request processed in 542us (826us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787855868.944457:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:0.0:1787855868.945593:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c97312c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7616:1874702486275712:192.168.201.38@tcp:105: 00010000:00010000:0.0:1787855868.945649:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855868.945713:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c53d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2358:x1874702464238080:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 6434us (9299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855868.945727:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:3.0:1787855869.055257:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c97312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486275840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787855869.055365:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855869.055853:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486275840 00000100:00100000:2.0:1787855869.055865:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486275840 00000100:00100000:2.0:1787855869.055938:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787855869.055948:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df807840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486275840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787855869.056006:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787855869.056092:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df807840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486275840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855869.056099:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787855869.056200:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c97312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486275840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787855869.107334:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855869.107454:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464238464 00000100:00100000:0.0:1787855869.107469:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464238464 00000100:00100000:0.0:1787855869.107595:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 97 00000100:00100000:0.0:1787855869.107607:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+34:10519:x1874702464238464:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1787855869.107651:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855869.107679:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dcff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c35 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.107768:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366dd06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.107807:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366dd06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.107822:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366dd06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855869.107900:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787855869.107959:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787855869.107994:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366dd06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.108028:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366dcff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c35 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.108077:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366dd06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c35 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.108088:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:0.0:1787855869.108091:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787855869.108096:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142400, rc 0) 00000100:00100000:0.0:1787855869.108182:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+35:10519:x1874702464238464:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 577us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855869.108191:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 97 00000100:00100000:1.0:1787855869.134029:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855869.134163:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464238720 00000100:00100000:2.0:1787855869.134175:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464238720 00000100:00100000:2.0:1787855869.134255:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 98 00000100:00100000:2.0:1787855869.134268:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+35:10519:x1874702464238720:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1787855869.134300:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855869.134330:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366dd0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c3c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.134486:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dd14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.134507:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dd14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.134520:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dd14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855869.134533:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787855869.134890:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366dd0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c3c expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.134915:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dd14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c3c expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.135003:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1d200) 00010000:00010000:2.0:1787855869.135024:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787855869.135029:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887400, rc 0) 00000100:00100000:2.0:1787855869.135117:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+37:10519:x1874702464238720:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 850us (1103us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787855869.135126:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 98 00000100:00100000:3.0:1787855869.140440:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855869.140625:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855869.141143:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464238848 00000100:00100000:0.0:1787855869.141159:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464238848 00000100:00100000:0.0:1787855869.141269:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:0.0:1787855869.141283:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df8070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+37:2357:x1874702464238848:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855869.141306:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855869.141342:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dd14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c3c expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.141369:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1d200) 00010000:00010000:0.0:1787855869.141377:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855869.141482:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df8070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+36:2357:x1874702464238848:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 201us (2591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855869.141502:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:2.0:1787855869.144905:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464239104 00000100:00100000:2.0:1787855869.144928:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464239104 00000100:00100000:2.0:1787855869.145062:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:2.0:1787855869.145075:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df804f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+36:10519:x1874702464239104:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1787855869.145108:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855869.145137:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366dd22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c43 expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.145287:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366dd29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.145307:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366dd29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.145321:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366dd29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855869.145334:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787855869.145564:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366dd22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c43 expref: 39 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.145596:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366dd29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c43 expref: 38 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.145620:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1d200) 00010000:00010000:2.0:1787855869.145623:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787855869.145628:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7886400, rc 0) 00000100:00100000:2.0:1787855869.145740:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df804f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+38:10519:x1874702464239104:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 666us (5126us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787855869.145748:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:3.0:1787855869.154979:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855869.155159:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464239232 00000100:00100000:0.0:1787855869.155173:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464239232 00000100:00100000:0.0:1787855869.155296:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:0.0:1787855869.155310:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464239232:12345-192.168.201.38@tcp:1:lfs.0 00010000:00010000:0.0:1787855869.155410:0:8077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e541075/0x516929ca3366dd37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.155447:0:8077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c2e expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.155459:0:8077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787855869.155465:0:8077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787855869.155472:0:8077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e541075/0x516929ca3366dd37 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.155519:0:8077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c2e expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.155547:0:8077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c2e expref: 6 pid: 6679 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855869.155568:0:8077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c97312c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8077:1874702486275968:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787855869.155711:0:8077:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855869.157924:0:8077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c97312c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8077:1874702486275968:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855869.157960:0:8077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e541075/0x516929ca3366dd37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855869.158234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855869.158321:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464239360 00000100:00100000:1.0:1787855869.158330:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464239360 00002000:00100000:1.0:1787855869.158411:0:6686:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9a73df806580 x1874702464239360/t0(0) o4->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:25/0 lens 504/0 e 0 to 0 dl 1787855880 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787855869.158428:0:6686:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73df806580 with x1874702464239360 ext(0->8) 00010000:00010000:1.0:1787855869.158438:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c2e expref: 7 pid: 6679 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.158457:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c2e expref: 7 pid: 6679 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787855869.158466:0:6686:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a73df806580 00000100:00100000:1.0:1787855869.158513:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:1.0:1787855869.158526:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df806580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2358:x1874702464239360:12345-192.168.201.38@tcp:4:lfs.0 00000100:00100000:1.0:1787855869.159946:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df806580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2358:x1874702464239360:12345-192.168.201.38@tcp:4:lfs.0 Request processed in 1411us (1702us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787855869.159962:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00002000:00100000:1.0:1787855869.159976:0:6686:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9a73df806580 x1874702464239360/t4294967302(0) o4->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:25/0 lens 504/448 e 0 to 0 dl 1787855880 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787855869.159987:0:6686:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73df806580 with x1874702464239360 ext(0->8) 00010000:00010000:1.0:1787855869.160007:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c2e expref: 9 pid: 6679 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.160026:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c2e expref: 9 pid: 6679 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787855869.160043:0:6686:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a73df806580 00000100:00100000:3.0:1787855869.161904:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855869.162180:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464239488 00000100:00100000:2.0:1787855869.162192:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464239488 00010000:00010000:2.0:1787855869.162245:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c2e expref: 9 pid: 6679 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855869.162342:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:2.0:1787855869.162355:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df805a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2358:x1874702464239488:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855869.162374:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787855869.162412:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787855869.162416:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787855869 00002000:00010000:2.0:1787855869.162418:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787855869 00002000:00010000:2.0:1787855869.162420:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787855869 00010000:00010000:2.0:1787855869.162427:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c2e expref: 9 pid: 6679 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.162444:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c2e expref: 9 pid: 6679 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.162480:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaf1ee1f/0x516929ca3366dcf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c2e expref: 9 pid: 6679 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.162529:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855869.162534:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855869.162542:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e541075/0x516929ca3366dd37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.162555:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e541075/0x516929ca3366dd37 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.162598:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855869.162689:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df805a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2358:x1874702464239488:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 336us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855869.162698:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 50 00010000:00010000:3.0:1787855869.163011:0:8077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e541075/0x516929ca3366dd37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.163023:0:8077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e541075/0x516929ca3366dd37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.163055:0:8077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e541075/0x516929ca3366dd37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.163065:0:8077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e541075/0x516929ca3366dd37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.163084:0:8077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e541075/0x516929ca3366dd37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.163093:0:8077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142c00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787855869.163098:0:8077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e541075/0x516929ca3366dd37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.163109:0:8077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e541075/0x516929ca3366dd37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.163124:0:8077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e541075/0x516929ca3366dd37 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.163133:0:8077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e541075/0x516929ca3366dd37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855869.163256:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2360:x1874702464239232:12345-192.168.201.38@tcp:1:lfs.0 Request processed in 7949us (8293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855869.163265:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:3.0:1787855869.167758:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855869.168349:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464239744 00000100:00100000:1.0:1787855869.168362:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464239744 00000100:00100000:1.0:1787855869.168451:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 26 00000100:00100000:1.0:1787855869.168464:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73dc261050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+38:10519:x1874702464239744:12345-192.168.201.38@tcp:35:lfs.0 00000004:00010000:1.0:1787855869.168734:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366dd29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c43 expref: 38 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787855869.169191:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1787855869.169461:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1787855869.171190:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1787855869.171284:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dd3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.171309:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dce3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c20 expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.171319:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dd3e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.171371:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c20 expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.171405:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dce3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c20 expref: 42 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855869.171424:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006ea1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1874702486276096:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855869.172122:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73f4996240 going to sleep for 11 seconds 00000100:00100000:3.0:1787855869.174924:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006ea1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1874702486276096:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787855869.174966:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dd3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855869.177349:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855869.177465:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464239872 00000100:00100000:0.0:1787855869.177477:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464239872 00010000:00010000:0.0:1787855869.177540:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dce3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c20 expref: 43 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855869.177592:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:0.0:1787855869.177603:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df8061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+43:2357:x1874702464239872:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855869.177631:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855869.177639:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dce3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c20 expref: 43 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.177652:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c20 expref: 43 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.177678:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366dce3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c20 expref: 43 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.177694:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1d200) 00010000:00010000:0.0:1787855869.177700:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dd3e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.177709:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dd3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.177716:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dd3e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.177750:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787855869.177908:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dd3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.177919:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dd3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787855869.178101:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787855869.178367:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787855869.178518:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1874702486276224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787855869.178595:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855869.178648:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c12ed000 going to sleep for 11 seconds 00000100:00100000:2.0:1787855869.178851:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486276224 00000100:00100000:2.0:1787855869.178859:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486276224 00000100:00100000:2.0:1787855869.178915:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787855869.178925:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1874702486276224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787855869.179032:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1874702486276224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855869.179040:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787855869.179231:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df8061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+44:2357:x1874702464239872:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1625us (1891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855869.179241:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:1.0:1787855869.180223:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1874702486276224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787855869.180880:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787855869.180977:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1874702486276352:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787855869.181364:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855869.181463:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2da3240 going to sleep for 11 seconds 00000100:00100000:2.0:1787855869.181511:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486276352 00000100:00100000:2.0:1787855869.181520:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486276352 00000100:00100000:2.0:1787855869.181672:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787855869.181686:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1874702486276352:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787855869.181965:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1874702486276352:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 281us (601us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787855869.181984:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787855869.182145:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006eb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1874702486276352:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787855869.182219:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787855869.182271:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dd3e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.182283:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dd3e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.182292:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dd3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.182300:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855869.182305:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dd3e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.182316:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dd3e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.182337:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1d200) 00010000:00010000:3.0:1787855869.182341:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787855869.182347:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dd3e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.182355:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366dd3e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787855869.182600:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787855869.182717:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1787855869.182729:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360034953159ns, next at 361034950705ns, rc = 0 00000001:00080000:3.0:1787855869.182736:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787855869.182770:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1d200) 00010000:00010000:3.0:1787855869.182810:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787855869.182819:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366dd29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c43 expref: 46 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855869.182949:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73dc261050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+45:10519:x1874702464239744:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 14486us (15204us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787855869.182958:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 26 00000020:00080000:3.0:1787855869.182962:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787855869.185978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855869.186220:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464240000 00000100:00100000:1.0:1787855869.186234:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464240000 00000100:00100000:1.0:1787855869.186355:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 100 00000100:00100000:1.0:1787855869.186367:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+45:10519:x1874702464240000:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787855869.186407:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855869.186437:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366dd45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c4a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.186511:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366dd45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c4a expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.186558:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366dd45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c4a expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.186580:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:1.0:1787855869.186583:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787855869.186587:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fec00, rc 0) 00000100:00100000:1.0:1787855869.186657:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+46:10519:x1874702464240000:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 293us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855869.186664:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 100 00000100:00100000:0.0:1787855869.188459:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855869.189056:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464240256 00000100:00100000:3.0:1787855869.189067:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464240256 00000100:00100000:3.0:1787855869.189139:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:3.0:1787855869.189151:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c97312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+46:10519:x1874702464240256:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1787855869.189624:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c97312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+47:10519:x1874702464240256:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 473us (1178us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787855869.189636:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:3.0:1787855869.253119:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855869.253196:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464240384 00000100:00100000:0.0:1787855869.253209:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464240384 00000100:00100000:0.0:1787855869.253327:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 101 00000100:00100000:0.0:1787855869.253339:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df804780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+47:10529:x1874702464240384:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:0.0:1787855869.253463:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.253488:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.253508:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.253527:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.253536:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.253542:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.253682:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366dd5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.253688:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366dd5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.253694:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366dd5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787855869.253738:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366dd5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.253766:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.253771:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254131:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254139:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855869.254144:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254151:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254163:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:0.0:1787855869.254166:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855869.254171:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254176:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254191:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254196:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254199:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254209:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855869.254211:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254214:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254218:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73f49fb000) 00010000:00010000:0.0:1787855869.254220:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855869.254221:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254224:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254236:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366dd5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254241:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366dd5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254245:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366dd5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254247:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855869.254249:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366dd5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254252:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366dd5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254262:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:0.0:1787855869.254264:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855869.254266:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366dd5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.254271:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366dd5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855869.254429:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df804780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+47:10529:x1874702464240384:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 1089us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855869.254440:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 101 00000100:00100000:2.0:1787855869.284910:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855869.284981:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464240640 00000100:00100000:0.0:1787855869.284993:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464240640 00000100:00100000:0.0:1787855869.285092:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 102 00000100:00100000:0.0:1787855869.285106:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+47:10532:x1874702464240640:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1787855869.285134:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855869.285357:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366dd61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c51 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285458:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285473:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285483:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285494:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285515:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285520:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285722:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366dd76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285729:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366dd76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285734:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366dd76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855869.285742:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787855869.285917:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285924:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285929:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285932:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855869.285936:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285942:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285962:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:0.0:1787855869.285965:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855869.285969:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285974:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dd68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285988:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285993:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.285998:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.286014:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855869.286017:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.286024:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.286032:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73f49fb000) 00010000:00010000:0.0:1787855869.286035:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855869.286038:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.286044:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dd6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.286114:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366dd61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c51 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.286130:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366dd76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c51 expref: 49 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.286136:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:0.0:1787855869.286137:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787855869.286278:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142800, rc 0) 00000100:00100000:0.0:1787855869.286349:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+49:10532:x1874702464240640:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1246us (1451us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1787855869.286359:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 102 00000100:00100000:1.0:1787855869.288372:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855869.288447:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464240768 00000100:00100000:2.0:1787855869.288458:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464240768 00000100:00100000:2.0:1787855869.288515:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 103 00000100:00100000:2.0:1787855869.288527:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+49:10532:x1874702464240768:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:2.0:1787855869.288612:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366dd84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.288632:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366dd84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.288647:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366dd84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.288675:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366dd84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.288682:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366dd84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.288689:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366dd84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.288695:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855869.288700:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366dd84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.288707:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366dd84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.288743:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:2.0:1787855869.288747:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787855869.288754:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366dd84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855869.288761:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366dd84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855869.288877:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+49:10532:x1874702464240768:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 352us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855869.288885:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 103 00000100:00100000:3.0:1787855869.291897:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855869.291954:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464241024 00000100:00100000:1.0:1787855869.291968:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464241024 00000100:00100000:1.0:1787855869.292098:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:1.0:1787855869.292112:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df805680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+49:10532:x1874702464241024:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1787855869.292380:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df805680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+50:10532:x1874702464241024:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 272us (497us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787855869.292396:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:3.0:1787855869.370919:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855869.371059:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464241280 00000100:00100000:1.0:1787855869.371073:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464241280 00000100:00100000:1.0:1787855869.371217:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 104 00000100:00100000:1.0:1787855869.371231:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df805e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+50:10542:x1874702464241280:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1787855869.371267:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855869.371271:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787855869.371309:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366dd06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c35 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.371363:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:1.0:1787855869.371371:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787855869.371425:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366dd8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c58 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.371894:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366dd92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.371914:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366dd76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c51 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.371923:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366dd92 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.371966:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366dd76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c51 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.371982:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366dd76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c51 expref: 50 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855869.372066:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006e8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486276480:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855869.372183:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2da3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787855869.376218:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855869.376343:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006e8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486276480:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855869.376378:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366dd92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855869.376820:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464241408 00000100:00100000:3.0:1787855869.376828:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464241408 00010000:00010000:3.0:1787855869.376877:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366dd76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c51 expref: 51 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855869.376949:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:3.0:1787855869.376958:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9731e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+51:2358:x1874702464241408:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787855869.376974:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855869.376999:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366dd76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c51 expref: 51 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.377314:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366dd76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c51 expref: 51 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.377341:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366dd76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c51 expref: 51 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.377361:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:3.0:1787855869.377366:0:7616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366dd92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.377374:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366dd92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.377389:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366dd92 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.377426:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855869.377508:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9731e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+50:2358:x1874702464241408:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 550us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855869.377518:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 52 00010000:00010000:1.0:1787855869.377631:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366dd92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.377652:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366dd92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855869.377681:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787855869.377895:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366dd8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c58 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.377909:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366dd92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c58 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.377915:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:1.0:1787855869.377917:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787855869.377919:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ffe00, rc 0) 00000100:00100000:1.0:1787855869.377944:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df805e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+50:10542:x1874702464241280:12345-192.168.201.38@tcp:101:bash.0 Request processed in 6720us (7040us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1787855869.377949:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 104 00000100:00100000:3.0:1787855869.380748:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855869.380820:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464241664 00000100:00100000:0.0:1787855869.380831:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464241664 00000100:00100000:0.0:1787855869.380896:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 105 00000100:00100000:0.0:1787855869.380907:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df804b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+50:10542:x1874702464241664:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:0.0:1787855869.381238:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dda0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.381257:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dda0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.381276:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dda0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787855869.381320:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1787855869.381355:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bcc4a39 reply state 000000008428c808 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dda0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855869.381362:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787855869.381520:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df804b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+53:10542:x1874702464241664:12345-192.168.201.38@tcp:36:bash.0 Request processed in 613us (781us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787855869.381538:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 105 00000020:00080000:0.0:1787855869.381545:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787855869.384666:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dda0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.384689:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dda0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.384698:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dda0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.384706:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855869.384712:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dda0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.384722:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dda0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.384743:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:0.0:1787855869.384746:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855869.384750:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dda0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.384756:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366dda0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855869.385200:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855869.385451:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464241792 00000100:00100000:0.0:1787855869.385485:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464241792 00000100:00100000:0.0:1787855869.385582:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 106 00000100:00100000:0.0:1787855869.385592:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df806940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:10542:x1874702464241792:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1787855869.385621:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855869.385641:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dda7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c5f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.385730:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.385740:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366dd92 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c58 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.385748:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.385797:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366dd92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c58 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.385808:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366dd92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c58 expref: 53 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855869.385821:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9730b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874702486276608:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787855869.385914:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855869.387920:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855869.388023:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9730b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874702486276608:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855869.388058:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855869.388123:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464241920 00000100:00100000:1.0:1787855869.388130:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464241920 00010000:00010000:1.0:1787855869.388222:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366dd92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c58 expref: 54 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855869.388255:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:1.0:1787855869.388262:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:2357:x1874702464241920:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787855869.388284:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855869.388289:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366dd92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c58 expref: 54 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.388317:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366dd92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c58 expref: 54 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.388339:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366dd92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c58 expref: 54 pid: 5833 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.388352:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:1.0:1787855869.388355:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.388363:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.388370:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.388438:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855869.388511:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+53:2357:x1874702464241920:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 247us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855869.388520:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 53 00010000:00010000:0.0:1787855869.388988:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.389004:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855869.389060:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787855869.389065:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787855869.389088:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.389127:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366dda7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c5f expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.389246:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c5f expref: 52 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.389254:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:0.0:1787855869.389257:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787855869.389260:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143a00, rc 0) 00000100:00100000:0.0:1787855869.389459:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df806940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:10542:x1874702464241792:12345-192.168.201.38@tcp:101:bash.0 Request processed in 3867us (4265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855869.389467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 106 00000100:00100000:2.0:1787855869.391927:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855869.392059:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464242176 00000100:00100000:3.0:1787855869.392073:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464242176 00000100:00100000:3.0:1787855869.392207:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:3.0:1787855869.392217:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:10542:x1874702464242176:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:3.0:1787855869.392671:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+53:10542:x1874702464242176:12345-192.168.201.38@tcp:35:bash.0 Request processed in 455us (759us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1787855869.392679:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:2.0:1787855869.433679:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855869.433816:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464242304 00000100:00100000:1.0:1787855869.433829:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464242304 00000100:00100000:1.0:1787855869.433906:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 107 00000100:00100000:1.0:1787855869.433918:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+53:10548:x1874702464242304:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787855869.433952:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855869.433982:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366ddb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c66 expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.434106:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366ddbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.434124:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366ddbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.434148:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366ddbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855869.434223:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787855869.434228:0:9629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787855869.434256:0:9629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366ddbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.434285:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366ddb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c66 expref: 55 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.434307:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366ddbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c66 expref: 54 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.434317:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:1.0:1787855869.434320:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787855869.434525:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ffa00, rc 0) 00000100:00100000:1.0:1787855869.434606:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:10548:x1874702464242304:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 690us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855869.434615:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 107 00000100:00100000:2.0:1787855869.436934:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855869.437010:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464242432 00000100:00100000:1.0:1787855869.437021:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464242432 00000100:00100000:1.0:1787855869.437106:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 108 00000100:00100000:1.0:1787855869.437128:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:10548:x1874702464242432:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787855869.437155:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855869.437180:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366ddc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c6d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.437248:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.437264:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.437275:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.437295:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366ddd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.437302:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366ddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.437309:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366ddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.437442:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366ddd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.437452:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366ddd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.437459:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366ddd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855869.438803:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787855869.438811:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787855869.438835:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366ddd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.438852:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366ddd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.438860:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.438865:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.438870:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.438874:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855869.438879:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.438884:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.438896:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:1.0:1787855869.438899:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855869.438903:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.438908:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.438948:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366ddd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.438955:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366ddd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.438961:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366ddd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.438967:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855869.438970:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366ddd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.438977:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366ddd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.438983:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73c8d1d700) 00010000:00010000:1.0:1787855869.438985:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855869.438988:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366ddd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.438995:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366ddd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.439041:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366ddc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c6d expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.439054:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366ddd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c6d expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.439068:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:1.0:1787855869.439069:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787855869.439071:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe600, rc 0) 00000100:00100000:1.0:1787855869.439154:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:10548:x1874702464242432:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 2037us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855869.439163:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 108 00000100:00100000:2.0:1787855869.445076:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855869.445214:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464242816 00000100:00100000:3.0:1787855869.445227:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464242816 00000100:00100000:3.0:1787855869.445693:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:3.0:1787855869.445707:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c92830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:2359:x1874702464242816:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787855869.445730:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855869.445764:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366ddd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c6d expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.445818:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:3.0:1787855869.445825:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855869.446012:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c92830c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:2359:x1874702464242816:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 307us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855869.446021:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:2.0:1787855869.446218:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855869.446900:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464242688 00000100:00100000:3.0:1787855869.446910:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464242688 00000100:00100000:3.0:1787855869.446965:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 109 00000100:00100000:3.0:1787855869.446975:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:10548:x1874702464242688:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855869.446999:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855869.447023:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366dddf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c74 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.447155:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dde6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.447188:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c5f expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.447198:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dde6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.447236:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c5f expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.447251:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c5f expref: 55 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855869.447958:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8052c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874702486276736:192.168.201.38@tcp:104: 00000100:00100000:3.0:1787855869.448125:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9ac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855869.452205:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855869.452322:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464242944 00000100:00100000:0.0:1787855869.452333:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464242944 00010000:00010000:0.0:1787855869.452398:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c5f expref: 56 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855869.452452:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:0.0:1787855869.452465:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c554ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:2357:x1874702464242944:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855869.452520:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855869.452539:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c5f expref: 56 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.452555:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c5f expref: 56 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.452585:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:0.0:1787855869.452593:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dde6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.452604:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dde6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.452623:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dde6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.452647:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855869.452727:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c554ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:2357:x1874702464242944:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 264us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855869.452736:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 54 00010000:00010000:3.0:1787855869.453362:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ddae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c5f expref: 55 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855869.453400:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8052c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874702486276736:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787855869.453428:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dde6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.453440:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dde6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.453446:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dde6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855869.453471:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787855869.453696:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366dddf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c74 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.453715:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dde6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c74 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.453724:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:3.0:1787855869.453728:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787855869.453731:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229000, rc 0) 00000100:00100000:3.0:1787855869.453889:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:10548:x1874702464242688:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 6916us (7672us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787855869.453900:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 109 00000100:00100000:1.0:1787855869.458465:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855869.458717:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464243200 00000100:00100000:3.0:1787855869.458729:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464243200 00000100:00100000:3.0:1787855869.458948:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:3.0:1787855869.458961:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:10548:x1874702464243200:12345-192.168.201.38@tcp:103:lfs.0 00010000:00010000:3.0:1787855869.458983:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855869.459016:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366dd45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c4a expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855869.459039:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:3.0:1787855869.459045:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855869.459157:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:10548:x1874702464243200:12345-192.168.201.38@tcp:103:lfs.0 Request processed in 199us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855869.459167:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:2.0:1787855869.461460:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855869.461744:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464243328 00000100:00100000:0.0:1787855869.461758:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464243328 00000100:00100000:0.0:1787855869.462704:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 110 00000100:00100000:0.0:1787855869.462718:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:10548:x1874702464243328:12345-192.168.201.38@tcp:58:lfs.0 00010000:00010000:0.0:1787855869.462880:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ddf4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.462900:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ddf4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855869.462932:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ddf4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787855869.463186:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787855869.463311:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:10548:x1874702464243328:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 595us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855869.463320:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 110 00000100:00100000:3.0:1787855869.465672:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855869.466874:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464243456 00000100:00100000:1.0:1787855869.466892:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464243456 00000100:00100000:1.0:1787855869.466971:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 111 00000100:00100000:1.0:1787855869.466984:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df8052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:10548:x1874702464243456:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787855869.467012:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855869.467043:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c7b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.467135:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ddf4 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.467147:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddfb lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c7b expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.467171:0:5833:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ddf4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.467188:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddfb lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c7b expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.467226:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:1.0:1787855869.467230:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787855869.467235:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddfb lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c7b expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855869.467243:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ff200, rc 0) 00000100:00100000:1.0:1787855869.467333:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df8052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:10548:x1874702464243456:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 352us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855869.467341:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 111 00010000:00010000:3.0:1787855869.692200:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787855870.332145:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787855870.332164:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787855870.332245:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787855870.332254:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787855870.332661:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfda40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874702486276864:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787855870.332924:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d06626c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855870.338042:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855870.338142:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464243584 00000100:00100000:1.0:1787855870.338155:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464243584 00000100:00100000:1.0:1787855870.338258:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 112 00000100:00100000:1.0:1787855870.338288:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:10549:x1874702464243584:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787855870.338337:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787855870.338933:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:10549:x1874702464243584:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 647us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855870.338945:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 112 00000100:00080000:3.0:1787855870.342891:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855870.343884:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855870.343994:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464243712 00000100:00100000:3.0:1787855870.344007:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464243712 00000100:00100000:3.0:1787855870.344135:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 113 00000100:00100000:3.0:1787855870.344149:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:10549:x1874702464243712:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787855870.344279:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366de02 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.344307:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366de02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.344326:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366de02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855870.346080:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfda40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874702486276864:192.168.201.38@tcp:107:hsm_cdtr.0 00010000:00010000:3.0:1787855870.347418:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366de09 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347446:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366de09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347460:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366de09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347498:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347508:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347515:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855870.347563:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787855870.347580:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787855870.347597:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347612:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366de02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347619:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366de02 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347626:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366de02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347633:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855870.347638:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366de02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347647:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366de02 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347662:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a73d40ac700) 00010000:00010000:3.0:1787855870.347666:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855870.347670:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366de02 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347677:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366de02 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347694:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366de09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347700:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366de09 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347716:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366de09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347722:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855870.347725:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366de09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347731:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366de09 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347739:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9a73d40ac000) 00010000:00010000:3.0:1787855870.347742:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855870.347745:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366de09 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347751:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366de09 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347766:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347816:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347824:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347830:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855870.347833:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347850:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347861:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:3.0:1787855870.347864:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855870.347867:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.347873:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855870.347971:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:10549:x1874702464243712:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 Request processed in 3820us (4096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855870.347982:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 113 00000100:00100000:1.0:1787855870.350034:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855870.350163:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464243968 00000100:00100000:2.0:1787855870.350172:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464243968 00000100:00100000:2.0:1787855870.350237:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 114 00000100:00100000:2.0:1787855870.350272:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:10549:x1874702464243968:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787855870.350296:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855870.350319:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366de17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c82 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.350984:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.351004:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.351014:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855870.351027:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787855870.351589:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.351600:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.351607:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.351613:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855870.351616:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.351623:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.351637:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:2.0:1787855870.351651:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787855870.351657:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.351664:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.351723:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366de17 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c82 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.351735:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a73d40ac700) 00010000:00010000:2.0:1787855870.351737:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787855870.351741:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366de17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c82 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.351752:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7886200, rc 0) 00000100:00100000:2.0:1787855870.352477:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:10549:x1874702464243968:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 2218us (2448us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787855870.352489:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 114 00000100:00100000:2.0:1787855870.363666:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855870.363817:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464244096 00000100:00100000:1.0:1787855870.363826:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464244096 00000100:00100000:1.0:1787855870.363897:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 115 00000100:00100000:1.0:1787855870.363906:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:10549:x1874702464244096:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787855870.363939:0:9629:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787855870.364040:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:10549:x1874702464244096:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 134us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855870.364061:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 115 00000100:00100000:1.0:1787855870.379115:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855870.379430:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464244352 00000100:00100000:0.0:1787855870.379439:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464244352 00000100:00100000:0.0:1787855870.379501:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 116 00000100:00100000:0.0:1787855870.379510:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:10549:x1874702464244352:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787855870.379530:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855870.379533:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787855870.379561:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366ddbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c66 expref: 56 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.379582:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:0.0:1787855870.379588:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787855870.379601:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366de2c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c89 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787855870.380377:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1787855870.380599:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366de33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.380616:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366de33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.380627:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366de33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.380679:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366de2c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c89 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.380698:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366de33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c89 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.380707:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a73c8d1d700) 00010000:00010000:1.0:1787855870.380710:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787855870.380712:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ffc00, rc 0) 00000100:00100000:1.0:1787855870.380834:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+57:10549:x1874702464244352:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1324us (1727us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787855870.380843:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 116 00000100:00100000:2.0:1787855870.386269:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855870.386671:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464244608 00000100:00100000:1.0:1787855870.386680:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464244608 00000100:00100000:1.0:1787855870.386839:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 117 00000100:00100000:1.0:1787855870.386848:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+57:10549:x1874702464244608:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787855870.386925:0:9629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855870.386950:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366de33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c89 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.386964:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a73c8d1d700) 00010000:00010000:1.0:1787855870.386974:0:9629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787855870.386991:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366de41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387001:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366de41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387007:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366de41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387065:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366de48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5eac1f28 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387073:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366de48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5eac1f28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387078:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366de48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5eac1f28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387144:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366de41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387148:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366de41 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387153:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366de41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387162:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855870.387166:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366de41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387171:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366de41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387177:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:1.0:1787855870.387179:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855870.387182:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366de41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387185:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366de41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387191:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366de48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5eac1f28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387195:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366de48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5eac1f28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387198:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366de48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5eac1f28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387201:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855870.387203:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366de48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5eac1f28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387206:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366de48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5eac1f28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387216:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5eac1f28 (ffff9a73c8d1d000) 00010000:00010000:1.0:1787855870.387218:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855870.387219:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366de48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5eac1f28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.387223:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366de48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5eac1f28 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855870.387288:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:10549:x1874702464244608:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 440us (1030us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787855870.387308:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 117 00000100:00100000:3.0:1787855870.390253:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855870.390888:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464244736 00000100:00100000:2.0:1787855870.390897:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464244736 00000100:00100000:2.0:1787855870.390960:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 118 00000100:00100000:2.0:1787855870.390970:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df8070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:10549:x1874702464244736:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787855870.390990:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855870.391012:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c90 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.391059:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366de56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.391071:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366de56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.391082:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366de56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.391175:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c90 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.391188:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366de56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c90 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.391195:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:2.0:1787855870.391198:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787855870.391200:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7886400, rc 0) 00000100:00100000:2.0:1787855870.391265:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df8070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+57:10549:x1874702464244736:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 296us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855870.391271:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 118 00000100:00100000:2.0:1787855870.394410:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855870.394603:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464244992 00000100:00100000:3.0:1787855870.394612:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464244992 00000100:00100000:3.0:1787855870.394719:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00100000:3.0:1787855870.394729:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+57:10549:x1874702464244992:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787855870.394844:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.394858:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.394867:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787855870.395103:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1787855870.395129:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361247353076ns, next at 362247350809ns, rc = 0 00000004:00010000:3.0:1787855870.395201:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000187ed825 reply state 00000000eb562066 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855870.395208:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787855870.395305:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+59:10549:x1874702464244992:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 566us (895us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787855870.395313:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 119 00000100:00100000:3.0:1787855870.408990:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00010000:1.0:1787855870.409182:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.409197:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.409206:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.409213:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855870.409220:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.409230:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.409254:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:1.0:1787855870.409258:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787855870.409275:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464245120 00010000:00010000:1.0:1787855870.409276:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855870.409293:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464245120 00010000:00010000:1.0:1787855870.409306:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366de5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855870.409462:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:2.0:1787855870.409476:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df805a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+58:10549:x1874702464245120:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787855870.409505:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855870.409544:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c97 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.409613:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c97 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.409625:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c97 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.409642:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:2.0:1787855870.409644:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787855870.409648:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887800, rc 0) 00000100:00100000:2.0:1787855870.410464:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df805a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+59:10549:x1874702464245120:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 983us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855870.410476:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:2.0:1787855870.413616:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855870.414296:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464245248 00000100:00100000:3.0:1787855870.414312:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464245248 00000100:00100000:3.0:1787855870.414428:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00080000:0.0:1787855870.414526:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787855870.414700:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2358:x1874702464245248:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787855870.415171:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2358:x1874702464245248:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 477us (1571us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787855870.418076:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:2.0:1787855870.424174:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855870.424423:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464245504 00000100:00100000:1.0:1787855870.424442:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464245504 00000100:00100000:1.0:1787855870.424563:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:1.0:1787855870.424571:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+59:10549:x1874702464245504:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787855870.424947:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+60:10549:x1874702464245504:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 375us (790us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787855870.424956:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:2.0:1787855870.435526:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855870.435707:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464245760 00000100:00100000:1.0:1787855870.435716:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464245760 00000100:00100000:1.0:1787855870.435896:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 121 00000100:00100000:1.0:1787855870.435908:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+60:10549:x1874702464245760:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787855870.436598:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+60:10549:x1874702464245760:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 689us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855870.436609:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 121 00000100:00100000:0.0:1787855870.446083:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855870.446167:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464245888 00000100:00100000:1.0:1787855870.446177:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464245888 00000100:00100000:1.0:1787855870.446243:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 122 00000100:00100000:1.0:1787855870.446253:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9731e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+60:10549:x1874702464245888:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787855870.446275:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855870.446309:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366de6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616c9e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.446425:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366de72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.446441:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366de72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.446453:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366de72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855870.446488:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787855870.446506:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366de72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.446530:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366de6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c9e expref: 62 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.446546:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366de72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c9e expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.446554:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:1.0:1787855870.446557:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787855870.446561:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe400, rc 0) 00000100:00100000:1.0:1787855870.446629:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9731e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+61:10549:x1874702464245888:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 377us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855870.446636:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 122 00000100:00100000:2.0:1787855870.460308:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855870.460439:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464246016 00000100:00100000:1.0:1787855870.460449:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464246016 00000100:00100000:1.0:1787855870.460516:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:1.0:1787855870.460541:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2358:x1874702464246016:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787855870.460561:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855870.460586:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041cc1465/0x516929ca3366de79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616ca5 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787855870.460617:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9083fe, blocks: 0x1 00010000:00010000:1.0:1787855870.460641:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1787855870.460646:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787855870.460656:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041cc1465/0x516929ca3366de79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ca5 expref: 10 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.460676:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000041cc1465/0x516929ca3366de79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ca5 expref: 10 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.460690:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ffc00, rc 0) 00000100:00100000:1.0:1787855870.460750:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+10:2358:x1874702464246016:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 210us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855870.460758:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:0.0:1787855870.466885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855870.467034:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464246272 00000100:00100000:3.0:1787855870.467047:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464246272 00000100:00100000:3.0:1787855870.467135:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 123 00000100:00100000:3.0:1787855870.467148:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9730b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+61:10549:x1874702464246272:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787855870.467302:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9730b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+61:10549:x1874702464246272:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 156us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855870.467310:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 123 00000100:00100000:0.0:1787855870.474028:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855870.474170:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464246400 00000100:00100000:1.0:1787855870.474185:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464246400 00000100:00100000:1.0:1787855870.474277:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:1.0:1787855870.474290:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+10:10549:x1874702464246400:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787855870.474315:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855870.474342:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce3ef308/0x516929ca3366de80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616cac expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.474407:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000041cc1465/0x516929ca3366de79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ca5 expref: 11 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.474418:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787855870.474424:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787855870.474431:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce3ef308/0x516929ca3366de80 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cac expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.474718:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000041cc1465/0x516929ca3366de79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ca5 expref: 11 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.474737:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000041cc1465/0x516929ca3366de79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ca5 expref: 11 pid: 6681 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855870.474756:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006e92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1874702486276992:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855870.474958:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2da3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787855870.483356:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006e92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1874702486276992:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855870.483413:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce3ef308/0x516929ca3366de80 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cac expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.483440:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe000, rc 0) 00000100:00100000:1.0:1787855870.483520:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ecb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+11:10549:x1874702464246400:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 9232us (9511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855870.483531:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:3.0:1787855870.486585:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855870.486857:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464246528 00000100:00100000:0.0:1787855870.486872:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464246528 00010000:00010000:0.0:1787855870.486934:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000041cc1465/0x516929ca3366de79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ca5 expref: 11 pid: 6681 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855870.486991:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:0.0:1787855870.487003:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df806d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+11:2358:x1874702464246528:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855870.487024:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855870.487055:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000041cc1465/0x516929ca3366de79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ca5 expref: 11 pid: 6681 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.487072:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000041cc1465/0x516929ca3366de79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ca5 expref: 11 pid: 6681 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.487103:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041cc1465/0x516929ca3366de79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ca5 expref: 11 pid: 6681 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.487125:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787855870.487131:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787855870.487142:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce3ef308/0x516929ca3366de80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cac expref: 10 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.487154:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce3ef308/0x516929ca3366de80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cac expref: 10 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.487204:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ce3ef308/0x516929ca3366de80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cac expref: 10 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855870.487243:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006ede00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1874702486277120:192.168.201.38@tcp:105: 00000100:00100000:0.0:1787855870.487533:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787855870.491276:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006ede00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1874702486277120:192.168.201.38@tcp:105: 00010000:00010000:1.0:1787855870.491313:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855870.491404:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df806d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+10:2358:x1874702464246528:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 4402us (4834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855870.491418:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:3.0:1787855870.502506:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855870.503067:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464246656 00000100:00100000:2.0:1787855870.503079:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464246656 00002000:00100000:2.0:1787855870.503143:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9a73df804000 x1874702464246656/t0(0) o4->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:26/0 lens 504/0 e 0 to 0 dl 1787855881 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787855870.503157:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73df804000 with x1874702464246656 ext(0->12) 00002000:00010000:2.0:1787855870.503166:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a73df804000 00000100:00100000:2.0:1787855870.503206:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:2.0:1787855870.503218:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+10:2357:x1874702464246656:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787855870.504122:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+12:2357:x1874702464246656:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 Request processed in 897us (1625us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787855870.504136:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00002000:00100000:2.0:1787855870.504146:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9a73df804000 x1874702464246656/t4294967308(0) o4->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:26/0 lens 504/448 e 0 to 0 dl 1787855881 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787855870.504156:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73df804000 with x1874702464246656 ext(0->12) 00002000:00010000:2.0:1787855870.504161:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a73df804000 00000100:00100000:2.0:1787855870.512450:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855870.512910:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464246784 00000100:00100000:1.0:1787855870.512924:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464246784 00000100:00100000:2.0:1787855870.513121:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:2.0:1787855870.513134:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+61:10549:x1874702464246784:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787855870.582403:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967394 is committed 00000001:00080000:2.0:1787855870.582443:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:2.0:1787855870.582467:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a73c2da3780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787855870.582473:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a73dfb40800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a73c2da3000 00000020:00080000:2.0:1787855870.582477:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a73dfb40400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a73fa588000 00000004:00080000:2.0:1787855870.582531:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787855870.582560:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a73f9d523c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787855870.582564:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a73f4a6ce00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a73f9d52240 00000020:00080000:2.0:1787855870.582567:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a73f4a6c600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a73cb630800 00000004:00080000:2.0:1787855870.582573:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1787855870.582583:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:2.0:1787855870.582812:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486277248:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787855870.582899:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855870.583000:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787855870.583007:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486277376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787855870.583031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855870.583070:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486277248 00000100:00100000:2.0:1787855870.583079:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486277248 00000100:00100000:2.0:1787855870.583160:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486277376 00000100:00100000:2.0:1787855870.583164:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486277376 00000100:00100000:2.0:1787855870.583188:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787855870.583197:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1874702486277248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787855870.583228:0:6681:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1787855870.583264:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366de87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.583292:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000520f8d23/0x516929ca3366dc49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c0b expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.583303:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787855870.583309:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855870.583315:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366de87 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.583348:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000520f8d23/0x516929ca3366dc49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c0b expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.583374:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000520f8d23/0x516929ca3366dc49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c0b expref: 11 pid: 6680 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855870.583388:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dff0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1874702486277504:192.168.201.38@tcp:104: 00000100:00100000:2.0:1787855870.583467:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d0662780 going to sleep for 11 seconds 00000100:00100000:2.0:1787855870.583488:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787855870.583496:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1874702486277376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787855870.583672:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787855870.583676:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787855870 00002000:00010000:2.0:1787855870.583679:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787855870.583682:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787855870 -> 1787855870 00002000:00010000:2.0:1787855870.583683:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787855870.583728:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3304:x1874702486277376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 233us (695us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787855870.583736:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1787855870.583814:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a73f9dffc00/2, rc 0, transno 4294967309 00000100:00100000:2.0:1787855870.583820:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486277376:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1787855870.586699:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787855870.587057:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787855870.590390:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855870.590434:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464246912 00000100:00100000:2.0:1787855870.590446:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464246912 00000100:00100000:3.0:1787855870.590692:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dff0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1874702486277504:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787855870.590750:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366de87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787855870.591036:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787855870.591101:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486277632:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787855870.591184:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855870.591350:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486277632 00000100:00100000:1.0:1787855870.591357:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486277632 00000100:00100000:1.0:1787855870.591432:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787855870.591444:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df8061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874702486277632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787855870.591480:0:6679:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1787855870.591535:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9083fd, atime: 0x6a9083fd, ctime: 0x6a9083fd, blocks: 0x1 00010000:00010000:1.0:1787855870.591545:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059141bfc/0x516929ca3366de8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.591563:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1787855870.591568:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787855870.591576:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059141bfc/0x516929ca3366de8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.591594:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059141bfc/0x516929ca3366de8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.591604:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059141bfc/0x516929ca3366de8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.591624:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059141bfc/0x516929ca3366de8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.591646:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787855870.592329:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df8061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1874702486277632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 885us (1141us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787855870.592340:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1787855870.592396:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787855870.592405:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059141bfc/0x516929ca3366de8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.592416:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff800 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787855870.592421:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059141bfc/0x516929ca3366de8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.592432:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059141bfc/0x516929ca3366de8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.592455:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059141bfc/0x516929ca3366de8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.592464:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059141bfc/0x516929ca3366de8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.592490:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855870.592501:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855870.592503:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855870.592708:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000520f8d23/0x516929ca3366dc49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c0b expref: 12 pid: 6680 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855870.592761:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:2.0:1787855870.592794:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+12:2360:x1874702464246912:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855870.592813:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855870.592819:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000520f8d23/0x516929ca3366dc49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c0b expref: 12 pid: 6680 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.592845:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000520f8d23/0x516929ca3366dc49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c0b expref: 12 pid: 6680 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.592865:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000520f8d23/0x516929ca3366dc49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c0b expref: 12 pid: 6680 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.592878:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855870.592882:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855870.592888:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366de87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.592898:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366de87 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.592923:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855870.592979:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+11:2360:x1874702464246912:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 210us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855870.592986:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00080000:3.0:1787855870.594218:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787855870.594293:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a74006e92c0/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787855870.594304:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486277632:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787855870.594335:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366de87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.594349:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366de87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.594360:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366de87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.594378:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366de87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.594406:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787855870.595137:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3304:x1874702486277248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11936us (12233us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787855870.595151:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:3.0:1787855870.595216:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a73f9dfc3c0/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787855870.595222:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486277248:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787855870.595251:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787855870.595259:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366de87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.595269:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887600 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787855870.595275:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366de87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.595285:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366de87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.595306:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366de87 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.595314:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366de87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.595335:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855870.595337:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855870.595339:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855870.598957:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:10549:x1874702464246784:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 Request processed in 85807us (86505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855870.598975:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 124 00000100:00100000:2.0:1787855870.604197:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855870.612789:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464247040 00000100:00100000:3.0:1787855870.612813:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464247040 00000100:00100000:3.0:1787855870.612919:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:3.0:1787855870.612932:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+11:2357:x1874702464247040:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787855870.699767:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+11:2357:x1874702464247040:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 Request processed in 86821us (95618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855870.699812:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00000001:00080000:1.0:1787855870.699867:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1787855870.699878:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1787855870.699892:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:3.0:1787855870.702988:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855870.703114:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464247296 00000100:00100000:0.0:1787855870.703125:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464247296 00000100:00100000:0.0:1787855870.703229:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 125 00000100:00100000:0.0:1787855870.703238:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:10549:x1874702464247296:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787855870.703305:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855870.703342:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366de72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c9e expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.703377:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:0.0:1787855870.703384:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787855870.703423:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366de95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.703438:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366de95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.703445:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366de95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787855870.704408:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000808ebdd reply state 00000000933bc64c transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366de95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855870.704449:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787855870.704671:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+16:10549:x1874702464247296:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 1430us (1695us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787855870.704681:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 125 00000100:00100000:3.0:1787855870.710378:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855870.711851:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464247424 00000100:00100000:0.0:1787855870.711870:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464247424 00000100:00100000:1.0:1787855870.712095:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:1.0:1787855870.712108:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464247424:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00010000:00010000:2.0:1787855870.712452:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366de95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.712466:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366de95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.712475:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366de95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787855870.712481:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787855870.712484:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787855870 -> 1787855869 00002000:00010000:1.0:1787855870.712487:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787855869 00002000:00010000:1.0:1787855870.712488:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787855870 -> 1787855869 00002000:00010000:1.0:1787855870.712491:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1787855870.712500:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855870.712506:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366de95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.712516:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366de95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.712538:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:2.0:1787855870.712541:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855870.712548:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366de95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.712554:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366de95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855870.712583:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2357:x1874702464247424:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 477us (2234us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787855870.712592:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 44 00010000:00010000:1.0:1787855870.717392:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855870.723276:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855870.723650:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464247680 00000100:00100000:1.0:1787855870.723663:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464247680 00000100:00100000:1.0:1787855870.723740:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 126 00000100:00100000:1.0:1787855870.723753:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:10549:x1874702464247680:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787855870.723873:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366de9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.723895:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366de56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c90 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.723930:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366de9c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.723977:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366de56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c90 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.723994:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366de56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c90 expref: 15 pid: 5833 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855870.724014:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006e83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486277760:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855870.724166:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cc840 going to sleep for 11 seconds 00000100:00100000:0.0:1787855870.728355:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855870.728834:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464247808 00000100:00100000:2.0:1787855870.728846:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464247808 00010000:00010000:2.0:1787855870.728898:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366de56 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c90 expref: 16 pid: 5833 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855870.728939:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:2.0:1787855870.728950:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+16:2358:x1874702464247808:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855870.728973:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855870.728982:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366de56 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c90 expref: 16 pid: 5833 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.728998:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366de56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c90 expref: 16 pid: 5833 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.729044:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:2.0:1787855870.729049:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366de9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.729057:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366de9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.729064:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366de9c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.729082:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855870.729220:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ede00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+16:2358:x1874702464247808:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 272us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855870.729227:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 57 00010000:00010000:1.0:1787855870.729323:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366de56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c90 expref: 15 pid: 5833 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855870.729346:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006e83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486277760:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855870.729384:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366de9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.729396:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366de9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.729400:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366de9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.729432:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366de9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.729436:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366de9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.729448:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366de9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.729452:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855870.729456:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366de9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.729471:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366de9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.729478:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:1.0:1787855870.729480:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787855870.729483:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366de9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.729488:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366de9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855870.729530:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:10549:x1874702464247680:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 Request processed in 5781us (6322us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787855870.729536:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 126 00000100:00100000:3.0:1787855870.734878:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855870.735018:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464247936 00000100:00100000:1.0:1787855870.735031:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464247936 00000100:00100000:1.0:1787855870.735102:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:1.0:1787855870.735113:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2359:x1874702464247936:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787855870.735169:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000359f6323/0x516929ca3366dea3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.735195:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce3ef308/0x516929ca3366de80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cac expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.735215:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787855870.735220:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787855870.735226:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000359f6323/0x516929ca3366dea3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.735270:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce3ef308/0x516929ca3366de80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cac expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.735286:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce3ef308/0x516929ca3366de80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cac expref: 7 pid: 6679 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855870.735304:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006e83c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1874702486277888:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855870.735405:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cc840 going to sleep for 11 seconds 00000100:00100000:3.0:1787855870.744087:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855870.745331:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006e83c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1874702486277888:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855870.745389:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000359f6323/0x516929ca3366dea3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855870.745710:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464248064 00000100:00100000:2.0:1787855870.745721:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464248064 00010000:00010000:2.0:1787855870.745799:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce3ef308/0x516929ca3366de80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cac expref: 8 pid: 6679 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855870.745852:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:2.0:1787855870.745864:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d8960780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2358:x1874702464248064:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855870.745886:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855870.746184:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce3ef308/0x516929ca3366de80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cac expref: 8 pid: 6679 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.746199:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce3ef308/0x516929ca3366de80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cac expref: 8 pid: 6679 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.746260:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce3ef308/0x516929ca3366de80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cac expref: 8 pid: 6679 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.746281:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855870.746288:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855870.746295:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000359f6323/0x516929ca3366dea3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.746307:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000359f6323/0x516929ca3366dea3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.746345:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855870.746450:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d8960780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2358:x1874702464248064:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 587us (2379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855870.746470:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 58 00010000:00010000:1.0:1787855870.746552:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000359f6323/0x516929ca3366dea3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.746563:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000359f6323/0x516929ca3366dea3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.746596:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000359f6323/0x516929ca3366dea3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.746614:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000359f6323/0x516929ca3366dea3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.746623:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000359f6323/0x516929ca3366dea3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.746631:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fea00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787855870.746637:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000359f6323/0x516929ca3366dea3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.746648:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000359f6323/0x516929ca3366dea3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.746662:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000359f6323/0x516929ca3366dea3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.746672:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000359f6323/0x516929ca3366dea3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855870.746752:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2359:x1874702464247936:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 Request processed in 11640us (11887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855870.746762:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:3.0:1787855870.749416:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855870.749482:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464248320 00000100:00100000:1.0:1787855870.749496:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464248320 00000100:00100000:1.0:1787855870.749577:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 127 00000100:00100000:1.0:1787855870.749610:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa095a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:10549:x1874702464248320:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787855870.749724:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366deaa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.749746:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366deaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.749761:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366deaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.750320:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366deb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.750338:0:9629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c97 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.750349:0:9629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366deb1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.750405:0:9629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c97 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.750424:0:9629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c97 expref: 15 pid: 5833 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855870.750442:0:9629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006e83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9629:1874702486278016:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855870.750563:0:9629:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cc840 going to sleep for 11 seconds 00000100:00100000:1.0:1787855870.753007:0:9629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006e83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9629:1874702486278016:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855870.753045:0:9629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366deb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855870.758014:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855870.758313:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464248448 00000100:00100000:0.0:1787855870.758326:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464248448 00010000:00010000:0.0:1787855870.758395:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c97 expref: 16 pid: 5833 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855870.758447:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:0.0:1787855870.758465:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+16:2358:x1874702464248448:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855870.758486:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855870.758493:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c97 expref: 16 pid: 5833 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.758516:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c97 expref: 16 pid: 5833 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.758546:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366de64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c97 expref: 16 pid: 5833 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.758568:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:0.0:1787855870.758574:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366deb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.758606:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366deb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.758624:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366deb1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.758659:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855870.758739:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:2358:x1874702464248448:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 275us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855870.758746:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 59 00010000:00010000:1.0:1787855870.758971:0:9629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366deb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.758987:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366deb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787855870.759219:0:9629:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1787855870.759376:0:9629:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1787855870.759429:0:9629:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1787855870.759544:0:9629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006e83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9629:1874702486278144:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787855870.759739:0:9629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855870.759832:0:9629:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cc900 going to sleep for 11 seconds 00000100:00100000:0.0:1787855870.764165:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486278144 00000100:00100000:0.0:1787855870.764188:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486278144 00000100:00100000:0.0:1787855870.764259:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787855870.764270:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9629:x1874702486278144:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787855870.764464:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9629:x1874702486278144:12345-0@lo:1000:mdt00_003.0 Request processed in 186us (4716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855870.764473:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787855870.764540:0:9629:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787855870.764547:0:9629:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1787855870.764570:0:9629:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a73f9dffc00, transno 4294967309 00000004:00080000:0.0:1787855870.764578:0:9629:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a73f9dfc3c0, transno 4294967310 00000100:00100000:0.0:1787855870.764586:0:9629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006e83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9629:1874702486278144:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787855870.765256:0:9629:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787855870.765379:0:9629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006ec3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9629:1874702486278272:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787855870.765444:0:9629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855870.765487:0:9629:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787855870.765514:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486278272 00000100:00100000:0.0:1787855870.765528:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486278272 00000100:00100000:0.0:1787855870.765563:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787855870.765571:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c92830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9629:x1874702486278272:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787855870.765823:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c92830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9629:x1874702486278272:12345-0@lo:1000:mdt00_003.0 Request processed in 252us (378us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787855870.765831:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787855870.765872:0:9629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006ec3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9629:1874702486278272:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787855870.765911:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366deb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.765923:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366deb1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.765932:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366deb1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.765938:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffe00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855870.765944:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366deb1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.765954:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366deb1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.765974:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:0.0:1787855870.765977:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787855870.765983:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366deb1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.765990:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366deb1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.766038:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ddf4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.766045:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ddf4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.766052:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ddf4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.766057:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855870.766060:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ddf4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.766066:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ddf4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.766075:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:0.0:1787855870.766077:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787855870.766085:0:9629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c7b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.766098:0:9629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddfb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c7b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.766109:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c7b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.766138:0:9629:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c7b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855870.766162:0:9629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006961c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9629:1874702486278400:192.168.201.38@tcp:105: 00000100:00100000:0.0:1787855870.766236:0:9629:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787855870.771023:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855870.771381:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464248576 00000100:00100000:2.0:1787855870.771393:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464248576 00000100:00100000:2.0:1787855870.771469:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:2.0:1787855870.771479:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:10548:x1874702464248576:12345-192.168.201.38@tcp:49:lfs.0 00000100:00100000:2.0:1787855870.771747:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:10548:x1874702464248576:12345-192.168.201.38@tcp:49:lfs.0 Request processed in 268us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855870.771756:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:0.0:1787855870.772193:0:9629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006961c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9629:1874702486278400:192.168.201.38@tcp:105: 00010000:00010000:0.0:1787855870.772226:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ddf4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772239:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ddf4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772287:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366deb8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772306:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366deb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772320:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366deb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772331:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366deb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772338:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366deb8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772345:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366deb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772352:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855870.772356:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366deb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772394:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366deb8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772409:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:0.0:1787855870.772413:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855870.772417:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366deb8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772423:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366deb8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772433:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366deaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772440:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366deaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772447:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366deaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772451:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855870.772454:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366deaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772460:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366deaa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772466:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:0.0:1787855870.772469:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787855870.772471:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366deaa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.772486:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366deaa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855870.773179:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa095a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:10549:x1874702464248320:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 23567us (23773us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787855870.773192:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 127 00000020:00080000:0.0:1787855870.773199:0:9629:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787855870.773999:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787855870.774007:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787855870.774646:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787855870.774675:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787855870.775530:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855870.775592:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464248832 00000100:00100000:2.0:1787855870.775602:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464248832 00000100:00100000:2.0:1787855870.775656:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 128 00000100:00100000:2.0:1787855870.775668:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:10548:x1874702464248832:12345-192.168.201.38@tcp:58:lfs.0 00000040:00080000:2.0:1787855870.776114:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787855870.776200:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:10548:x1874702464248832:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 533us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855870.776207:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 128 00000100:00100000:3.0:1787855870.779295:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855870.779378:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464249088 00000100:00100000:1.0:1787855870.779391:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464249088 00000100:00100000:1.0:1787855870.779468:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:1.0:1787855870.779481:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73dc261850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:10549:x1874702464249088:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787855870.780599:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787855870.780720:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1787855870.780772:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366debf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.780830:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366debf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.780843:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366debf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.780853:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366debf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.780869:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366debf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.780875:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366debf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.780903:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787855870.781070:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787855870.781079:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366debf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.781088:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fea00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787855870.781093:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366debf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.781102:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366debf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855870.781105:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73dc261850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+20:10549:x1874702464249088:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 1621us (1817us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787855870.781116:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 32 00010000:00010000:3.0:1787855870.781120:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a73c8d1d000) 00010000:00010000:3.0:1787855870.781123:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000020:00080000:1.0:1787855870.781124:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787855870.781129:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366debf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.781135:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366debf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.781153:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855870.781155:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855870.781156:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855870.803012:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855870.803141:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464249216 00000100:00100000:3.0:1787855870.803156:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464249216 00000100:00100000:3.0:1787855870.803274:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 129 00000100:00100000:3.0:1787855870.803288:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+20:10551:x1874702464249216:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855870.803338:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855870.803382:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366dec6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616cb3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.803469:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366decd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.803489:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366decd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.803503:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366decd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.803522:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366ded4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.803529:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366ded4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855870.803536:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366ded4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.804881:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dedb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.804902:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dde6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c74 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.804911:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dedb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.804964:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dde6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c74 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855870.804985:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dde6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c74 expref: 21 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855870.805004:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dffc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874702486278528:192.168.201.38@tcp:104: 00000100:00100000:2.0:1787855870.805164:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d0662840 going to sleep for 11 seconds 00000100:00100000:2.0:1787855870.812544:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855870.812684:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dffc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874702486278528:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855870.812720:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dedb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855870.812985:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464249472 00000100:00100000:3.0:1787855870.812995:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464249472 00000100:00100000:2.0:1787855870.813150:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:2.0:1787855870.813179:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+22:5596:x1874702464249472:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787855870.813618:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+23:5596:x1874702464249472:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 439us (1088us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787855870.813628:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:3.0:1787855870.815892:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855870.816031:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464249600 00000100:00100000:1.0:1787855870.816043:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464249600 00010000:00010000:1.0:1787855870.816099:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dde6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c74 expref: 23 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855870.816164:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:1.0:1787855870.816176:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c5549c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+23:2357:x1874702464249600:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787855870.816195:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855870.816202:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dde6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c74 expref: 23 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.816218:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dde6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c74 expref: 23 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.816245:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dde6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c74 expref: 23 pid: 5834 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.816286:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:1.0:1787855870.816293:0:7616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dedb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.816304:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.816313:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dedb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855870.816365:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855870.816444:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c5549c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+22:2357:x1874702464249600:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 269us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855870.816452:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 60 00010000:00010000:0.0:1787855870.817448:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.817465:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855870.817594:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787855870.817600:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787855870.817625:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.817643:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.817654:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366decd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.817662:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366decd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.817685:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366decd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.817692:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855870.817697:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366decd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.817706:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366decd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.817721:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:0.0:1787855870.817725:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855870.817730:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366decd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.817737:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366decd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.817753:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366ded4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.817759:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366ded4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.817765:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366ded4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.817769:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855870.817772:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366ded4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.818398:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366ded4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.818410:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a73d40aca00) 00010000:00010000:0.0:1787855870.818413:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855870.818417:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366ded4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.818423:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366ded4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.818553:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366dec6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cb3 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.818573:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dedb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cb3 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855870.818582:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:0.0:1787855870.818585:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787855870.818587:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887400, rc 0) 00000100:00100000:0.0:1787855870.818689:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:10551:x1874702464249216:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 15403us (15692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855870.818701:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 129 00010000:00010000:2.0:1787855871.751186:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787855871.804008:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787855871.804017:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787855871.804055:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787855871.804061:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787855871.804220:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfcf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874702486278656:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787855871.804539:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d0662240 going to sleep for 11 seconds 00000100:00100000:0.0:1787855871.820868:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfcf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874702486278656:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787855871.822922:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855871.823011:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464249728 00000100:00100000:1.0:1787855871.823021:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464249728 00000100:00100000:1.0:1787855871.823078:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 130 00000100:00100000:1.0:1787855871.823089:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1322d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:10562:x1874702464249728:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787855871.823128:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787855871.823250:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1322d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:10562:x1874702464249728:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 162us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855871.823258:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 130 00000100:00100000:3.0:1787855871.830885:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855871.847025:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464249984 00000100:00100000:2.0:1787855871.847042:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464249984 00000100:00100000:2.0:1787855871.847158:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 131 00000100:00100000:2.0:1787855871.847181:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:10562:x1874702464249984:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787855871.847202:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855871.847225:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886000/0x516929ca3366dee2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616cba expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855871.847325:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366dee9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855871.847353:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366dee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855871.847366:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366dee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855871.847391:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787855871.851677:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886000/0x516929ca3366dee2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cba expref: 24 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855871.851705:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366dee9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cba expref: 23 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855871.851714:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:2.0:1787855871.851717:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787855871.851721:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887e00, rc 0) 00000100:00100000:2.0:1787855871.851833:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+23:10562:x1874702464249984:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 4665us (20964us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787855871.851842:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 131 00000100:00100000:0.0:1787855871.868489:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855871.868610:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855871.868644:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464250368 00000100:00100000:0.0:1787855871.868659:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464250368 00000100:00100000:0.0:1787855871.868718:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:0.0:1787855871.868729:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+23:2358:x1874702464250368:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855871.868746:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855871.868803:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366dee9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cba expref: 23 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855871.868819:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:0.0:1787855871.868824:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855871.868874:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+22:2358:x1874702464250368:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 147us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855871.868882:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:0.0:1787855871.868905:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464250240 00000100:00100000:0.0:1787855871.868922:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464250240 00000100:00100000:0.0:1787855871.868947:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 132 00000100:00100000:0.0:1787855871.868953:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7423840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+22:10562:x1874702464250240:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787855871.869017:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366def7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855871.869032:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366def7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855871.869042:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366def7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855871.869656:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366def7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855871.869667:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366def7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855871.869680:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366def7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855871.869686:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855871.869691:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366def7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855871.869699:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366def7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855871.869709:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:0.0:1787855871.869713:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787855871.869717:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366def7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855871.869723:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366def7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855871.869873:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7423840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+23:10562:x1874702464250240:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 918us (1260us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1787855871.869882:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 132 00000040:00080000:0.0:1787855871.870351:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787855871.870356:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787855871.870892:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787855871.870901:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787855871.872193:0:12095:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787855871.872201:0:12095:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787855871.872259:0:12095:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787855871.872264:0:12095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787855871.875583:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855871.875721:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464250624 00000100:00100000:0.0:1787855871.875734:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464250624 00000100:00100000:0.0:1787855871.876199:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:0.0:1787855871.876209:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+23:10562:x1874702464250624:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787855871.876455:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+24:10562:x1874702464250624:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 246us (880us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787855871.876463:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:0.0:1787855872.251169:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855872.251495:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464250880 00000100:00100000:3.0:1787855872.251506:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464250880 00000100:00100000:3.0:1787855872.251645:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 133 00000100:00100000:3.0:1787855872.251657:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+24:10575:x1874702464250880:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855872.251682:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855872.251704:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366defe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616cc1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855872.251849:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366df05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855872.251865:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366df05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855872.251877:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366df05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855872.251889:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787855872.252041:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366defe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cc1 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855872.252061:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366df05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cc1 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855872.252070:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:3.0:1787855872.252073:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787855872.252076:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228a00, rc 0) 00000100:00100000:3.0:1787855872.252132:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+26:10575:x1874702464250880:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 478us (973us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787855872.252147:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 133 00000100:00080000:1.0:1787855872.257199:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855872.261428:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855872.261532:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464251008 00000100:00100000:1.0:1787855872.261542:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464251008 00000100:00100000:1.0:1787855872.261601:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 134 00000100:00100000:1.0:1787855872.261611:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+26:10575:x1874702464251008:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:1.0:1787855872.261699:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366df13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855872.261718:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366df13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855872.261731:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366df13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855872.261770:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366df13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855872.261815:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366df13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855872.261822:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366df13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855872.261828:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855872.261833:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366df13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855872.261841:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366df13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855872.261853:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:1.0:1787855872.261856:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787855872.261861:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366df13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855872.261867:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe600/0x516929ca3366df13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855872.261960:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+26:10575:x1874702464251008:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 348us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855872.261967:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 134 00000100:00100000:0.0:1787855872.545827:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855872.545915:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464251136 00000100:00100000:3.0:1787855872.545998:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464251136 00000100:00100000:3.0:1787855872.546120:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:3.0:1787855872.546133:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2358:x1874702464251136:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:3.0:1787855872.546152:0:8077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855872.546177:0:8077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b634f69c/0x516929ca3366df1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616cc8 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787855872.546206:0:8077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9083fd, atime: 0x6a9083fd, ctime: 0x6a9083fd, blocks: 0xb 00010000:00010000:3.0:1787855872.546227:0:8077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1787855872.546232:0:8077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855872.546242:0:8077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b634f69c/0x516929ca3366df1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cc8 expref: 7 pid: 8077 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855872.546263:0:8077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b634f69c/0x516929ca3366df1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cc8 expref: 7 pid: 8077 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855872.546277:0:8077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229200, rc 0) 00000100:00100000:3.0:1787855872.546354:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2358:x1874702464251136:12345-192.168.201.38@tcp:101:cat.0 Request processed in 223us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855872.546361:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00080000:0.0:1787855872.557537:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787855872.559547:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855872.559655:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464251264 00000100:00100000:1.0:1787855872.559665:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464251264 00002000:00100000:1.0:1787855872.559718:0:6686:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9a73d1323480 x1874702464251264/t0(0) o3->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:28/0 lens 488/0 e 0 to 0 dl 1787855883 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787855872.559730:0:6686:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73d1323480 with x1874702464251264 ext(0->4095) 00002000:00010000:1.0:1787855872.559736:0:6686:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a73d1323480 00000100:00100000:1.0:1787855872.559771:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:1.0:1787855872.559816:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2357:x1874702464251264:12345-192.168.201.38@tcp:3:cat.0 00000100:00100000:1.0:1787855872.560078:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2357:x1874702464251264:12345-192.168.201.38@tcp:3:cat.0 Request processed in 262us (539us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787855872.560088:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00002000:00100000:1.0:1787855872.560094:0:6686:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9a73d1323480 x1874702464251264/t0(0) o3->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:28/0 lens 488/4536 e 0 to 0 dl 1787855883 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787855872.560103:0:6686:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73d1323480 with x1874702464251264 ext(0->4095) 00002000:00010000:1.0:1787855872.560107:0:6686:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a73d1323480 00010000:00010000:3.0:1787855872.764366:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855873.155098:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787855873.155134:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486278784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855873.155207:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855873.155292:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486278784 00000100:00100000:3.0:1787855873.155300:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486278784 00000100:00100000:3.0:1787855873.155371:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787855873.155381:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1322940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874702486278784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787855873.155429:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855873.155478:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1322940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874702486278784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855873.155486:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787855873.155542:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486278784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787855873.159287:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787855873.246259:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1787855873.246277:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1787855873.446951:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855873.446995:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855873.447027:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855873.447061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855873.447111:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855873.447144:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464251904 00000100:00100000:2.0:1787855873.447153:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464251904 00000100:00100000:2.0:1787855873.447211:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464251520 00000100:00100000:2.0:1787855873.447214:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464251520 00000100:00100000:2.0:1787855873.447238:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 143 00000100:00100000:2.0:1787855873.447248:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2359:x1874702464251904:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855873.447331:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2359:x1874702464251904:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 84us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855873.447349:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 143 00000100:00100000:2.0:1787855873.447366:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 144 00000100:00100000:2.0:1787855873.447372:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+26:2359:x1874702464251520:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855873.447397:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+26:2359:x1874702464251520:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855873.447404:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 144 00000100:00100000:1.0:1787855873.447564:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464251392 00000100:00100000:1.0:1787855873.447569:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464251392 00000100:00100000:1.0:1787855873.447602:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 289 00000100:00100000:1.0:1787855873.447625:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c7167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2359:x1874702464251392:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855873.447657:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c7167450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2359:x1874702464251392:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 50us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855873.447673:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 289 00000100:00100000:1.0:1787855873.447702:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464251648 00000100:00100000:1.0:1787855873.447706:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464251648 00000100:00100000:1.0:1787855873.447727:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464251776 00000100:00100000:1.0:1787855873.447729:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464251776 00000100:00100000:1.0:1787855873.447752:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:1.0:1787855873.447758:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2359:x1874702464251648:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855873.447819:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2359:x1874702464251648:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 61us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855873.447825:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:1.0:1787855873.447837:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:1.0:1787855873.447843:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7488780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2359:x1874702464251776:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855873.447867:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7488780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2359:x1874702464251776:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 24us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855873.447873:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00080000:1.0:1787855873.447918:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787855873.447923:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855873.660222:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7489e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486279040:0@lo:400:kworker.0 00000100:00100000:0.0:1787855873.660296:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855873.660399:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787855873.660406:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486278912:0@lo:400:kworker.0 00000100:00100000:0.0:1787855873.660439:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855873.660471:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486279424:0@lo:400:kworker.0 00000100:00100000:0.0:1787855873.660495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855873.660640:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486279040 00000100:00100000:2.0:1787855873.660649:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486279040 00000100:00100000:2.0:1787855873.660701:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787855873.660711:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486279040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855873.660805:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486279040:12345-0@lo:400:kworker.0 Request processed in 95us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855873.660813:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787855873.660852:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7489e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486279040:0@lo:400:kworker.0 00000100:00100000:3.0:1787855873.661055:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e748a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486279296:0@lo:400:kworker.0 00000100:00100000:3.0:1787855873.661087:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855873.661113:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787855873.661120:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7488b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486279168:0@lo:400:kworker.0 00000100:00100000:3.0:1787855873.661143:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855873.661209:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486279296 00000100:00100000:0.0:1787855873.661213:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486279296 00000100:00100000:0.0:1787855873.661252:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486279168 00000100:00100000:0.0:1787855873.661255:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486279168 00000100:00100000:0.0:1787855873.661273:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787855873.661279:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1320b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486279296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855873.661327:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1320b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486279296:12345-0@lo:400:kworker.0 Request processed in 49us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855873.661334:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787855873.661368:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787855873.661375:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486279168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855873.661405:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486279168:12345-0@lo:400:kworker.0 Request processed in 31us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855873.661410:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787855873.661438:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7488b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486279168:0@lo:400:kworker.0 00000100:00100000:0.0:1787855873.661446:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e748a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486279296:0@lo:400:kworker.0 00000100:00080000:3.0:1787855873.661580:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855873.661649:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486278912 00000100:00100000:1.0:1787855873.661654:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486278912 00000100:00100000:1.0:1787855873.661692:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787855873.661699:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c4f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486278912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855873.661747:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c4f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3305:x1874702486278912:12345-0@lo:400:kworker.0 Request processed in 48us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855873.661752:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787855873.661817:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486279424 00000100:00100000:1.0:1787855873.661828:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486279424 00000100:00100000:1.0:1787855873.661862:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787855873.661868:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486279424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855873.661900:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486279424:12345-0@lo:400:kworker.0 Request processed in 32us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855873.661906:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1787855873.661923:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787855873.662056:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486278912:0@lo:400:kworker.0 00000100:00100000:3.0:1787855873.662068:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787855873.662073:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1787855873.662089:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a74006e92c0, transno 4294967304 00000100:00100000:3.0:1787855873.662105:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486279424:0@lo:400:kworker.0 00010000:00010000:3.0:1787855873.788041:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855874.172748:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787855874.172793:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa23f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486279552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787855874.172887:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855874.172983:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486279552 00000100:00100000:0.0:1787855874.172993:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486279552 00000100:00100000:0.0:1787855874.173069:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787855874.173080:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486279552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787855874.173129:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855874.173184:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486279552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855874.173191:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787855874.173250:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa23f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486279552:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787855874.822734:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787855874.941369:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787855874.941841:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787855874.941901:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787855874.941910:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787855875.837113:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787855875.879177:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:2.0:1787855875.879212:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a73e743ab40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787855875.879218:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a73fa6c9000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a73e743a300 00000020:00080000:2.0:1787855875.879223:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a73fa6c9e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a72c19c1c00 00000020:00080000:2.0:1787855875.879254:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1787855875.879281:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787855875.879698:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787855875.879971:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1787855875.883293:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1787855875.883317:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:2.0:1787855876.865768:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855877.892756:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855878.277880:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486279680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787855878.277972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855878.278065:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486279680 00000100:00100000:1.0:1787855878.278074:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486279680 00000100:00100000:1.0:1787855878.278139:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787855878.278148:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486279680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787855878.278208:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787855878.278266:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486279680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855878.278273:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1787855878.278297:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787855878.278737:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787855878.278745:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787855878.278807:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486279680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855878.564999:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855878.565106:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855878.565144:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855878.565172:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855878.565199:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855878.565243:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464252544 00000100:00100000:3.0:1787855878.565254:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464252544 00000100:00100000:3.0:1787855878.565349:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464252160 00000100:00100000:3.0:1787855878.565352:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464252160 00000100:00100000:3.0:1787855878.565379:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 148 00000100:00100000:3.0:1787855878.565391:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464252544:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855878.565490:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464252544:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 102us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855878.565497:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 148 00000100:00100000:3.0:1787855878.565516:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 149 00000100:00100000:3.0:1787855878.565521:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:2357:x1874702464252160:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855878.565543:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:2357:x1874702464252160:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 22us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855878.565548:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 149 00000100:00100000:3.0:1787855878.565567:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464252288 00000100:00100000:3.0:1787855878.565570:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464252288 00000100:00100000:3.0:1787855878.565595:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464252416 00000100:00100000:3.0:1787855878.565597:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464252416 00000100:00100000:3.0:1787855878.565615:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:3.0:1787855878.565620:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464252288:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855878.565643:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464252288:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 24us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855878.565669:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:3.0:1787855878.565680:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:3.0:1787855878.565685:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464252416:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855878.565705:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464252416:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 21us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855878.565710:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00080000:3.0:1787855878.565724:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787855878.565729:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787855878.565731:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855878.567423:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464252032 00000100:00100000:1.0:1787855878.567441:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464252032 00000100:00100000:1.0:1787855878.567536:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 291 00000100:00100000:1.0:1787855878.567545:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c54dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2357:x1874702464252032:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855878.567634:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c54dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2357:x1874702464252032:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 90us (2652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855878.567641:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 291 00000100:00100000:3.0:1787855878.625974:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855878.626304:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464252672 00000100:00100000:0.0:1787855878.626316:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464252672 00000100:00100000:0.0:1787855878.626409:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 135 00000100:00100000:0.0:1787855878.626439:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7447840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:10228:x1874702464252672:12345-192.168.201.38@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787855878.626585:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7447840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:10228:x1874702464252672:12345-192.168.201.38@tcp:60:lhsmtool_posix.0 Request processed in 148us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855878.626592:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 135 00000100:00100000:0.0:1787855878.630762:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855878.633089:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464252928 00000100:00100000:1.0:1787855878.633109:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464252928 00000100:00100000:0.0:1787855878.633722:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:0.0:1787855878.633736:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:10228:x1874702464252928:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787855878.635694:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:10228:x1874702464252928:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 1947us (4933us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787855878.635710:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:3.0:1787855878.780206:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa23da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486279936:0@lo:400:kworker.0 00000100:00100000:2.0:1787855878.780211:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa23f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874702486280192:0@lo:400:kworker.0 00000100:00100000:1.0:1787855878.780379:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa23e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486279808:0@lo:400:kworker.0 00000100:00100000:0.0:1787855878.781363:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa23e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486280064:0@lo:400:kworker.0 00000100:00100000:2.0:1787855878.786538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855878.786683:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486280192 00000100:00100000:2.0:1787855878.786712:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486280192 00000100:00100000:2.0:1787855878.786807:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787855878.786819:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e748bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874702486280192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855878.786896:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e748bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874702486280192:12345-0@lo:400:kworker.0 Request processed in 80us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855878.786904:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1787855878.786932:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855878.786973:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa23f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874702486280192:0@lo:400:kworker.0 00000100:00100000:3.0:1787855878.789512:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855878.790286:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486279936 00000100:00100000:2.0:1787855878.790299:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486279936 00000100:00100000:2.0:1787855878.790660:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787855878.790674:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7444b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486279936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855878.790799:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7444b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486279936:12345-0@lo:400:kworker.0 Request processed in 128us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855878.790808:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787855878.790837:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa23da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486279936:0@lo:400:kworker.0 00000100:00100000:1.0:1787855878.794614:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855878.794692:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa23c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486280320:0@lo:400:kworker.0 00000100:00100000:1.0:1787855878.794737:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855878.794828:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486279808 00000100:00100000:2.0:1787855878.794839:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486279808 00000100:00100000:0.0:1787855878.794903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855878.794921:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787855878.794934:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486279808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855878.794944:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486280320 00000100:00100000:3.0:1787855878.794948:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486280320 00000100:00080000:0.0:1787855878.794986:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787855878.795003:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787855878.795012:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486280320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855878.795021:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486280064 00000100:00100000:0.0:1787855878.795026:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486280064 00000100:00100000:0.0:1787855878.795065:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1787855878.795114:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855878.795167:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486280064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855878.795231:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486280064:12345-0@lo:400:kworker.0 Request processed in 149us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855878.795288:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787855878.795381:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486280320:12345-0@lo:400:kworker.0 Request processed in 370us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855878.795389:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787855878.795411:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa23e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486280064:0@lo:400:kworker.0 00000100:00100000:2.0:1787855878.795596:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486279808:12345-0@lo:400:kworker.0 Request processed in 664us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855878.795603:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787855878.795815:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa23e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486279808:0@lo:400:kworker.0 00000100:00100000:1.0:1787855878.795831:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa23c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486280320:0@lo:400:kworker.0 00010000:00010000:2.0:1787855878.908316:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855878.920178:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855878.920290:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464253056 00000100:00100000:3.0:1787855878.920304:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464253056 00000100:00100000:3.0:1787855878.920473:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 136 00000100:00100000:3.0:1787855878.920487:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:11029:x1874702464253056:12345-192.168.201.38@tcp:101:lsof.0 00010000:00010000:3.0:1787855878.920515:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855878.920570:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616ccf expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855878.920657:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366df28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855878.920674:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366df28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855878.920689:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366df28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855878.920965:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787855878.920969:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787855878.921048:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366df28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855878.921081:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ccf expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855878.921101:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366df28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ccf expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855878.921111:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:3.0:1787855878.921113:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787855878.921116:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228e00, rc 0) 00000100:00100000:3.0:1787855878.921183:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:11029:x1874702464253056:12345-192.168.201.38@tcp:101:lsof.0 Request processed in 699us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855878.921191:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 136 00000100:00100000:3.0:1787855879.292221:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa23e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486280448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787855879.292433:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855879.293591:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486280448 00000100:00100000:0.0:1787855879.294345:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486280448 00000100:00100000:0.0:1787855879.294433:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787855879.294446:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486280448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787855879.294506:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855879.294752:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486280448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 308us (2319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855879.294764:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787855879.294882:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa23e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486280448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787855879.933345:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787855880.893050:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1787855880.895533:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1787855880.895645:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787855880.895657:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787855880.956243:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855881.980175:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855883.008736:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787855883.324523:0:12299:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:38:02 (1787855882) 00000100:00100000:2.0:1787855883.391245:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787855883.391273:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e748ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486280576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787855883.392234:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855883.392649:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486280576 00000100:00100000:2.0:1787855883.392657:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486280576 00000100:00100000:2.0:1787855883.393164:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787855883.393176:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9748450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486280576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787855883.393215:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787855883.393807:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9748450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486280576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 630us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855883.393817:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1787855883.394851:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787855883.394909:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e748ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486280576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855883.706035:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855883.706074:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855883.706110:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855883.706154:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855883.706187:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855883.706216:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464253696 00000100:00100000:3.0:1787855883.706225:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464253696 00000100:00100000:2.0:1787855883.706264:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464253184 00000100:00100000:2.0:1787855883.706269:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464253184 00000100:00100000:3.0:1787855883.706299:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464253312 00000100:00100000:2.0:1787855883.706299:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 293 00000100:00100000:3.0:1787855883.706301:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464253312 00000100:00100000:2.0:1787855883.706309:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2360:x1874702464253184:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855883.706321:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 153 00000100:00100000:3.0:1787855883.706328:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:2360:x1874702464253696:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855883.706386:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:2360:x1874702464253696:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 58us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855883.706386:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2360:x1874702464253184:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 78us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855883.706395:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 153 00000100:00100000:2.0:1787855883.706395:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 293 00000100:00100000:3.0:1787855883.706418:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 154 00000100:00100000:3.0:1787855883.706424:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:2360:x1874702464253312:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855883.706451:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:2360:x1874702464253312:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855883.706478:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 154 00000100:00100000:3.0:1787855883.706496:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464253440 00000100:00100000:3.0:1787855883.706498:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464253440 00000100:00100000:3.0:1787855883.706523:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464253568 00000100:00100000:3.0:1787855883.706526:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464253568 00000100:00100000:3.0:1787855883.706546:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:3.0:1787855883.706552:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464253440:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855883.706556:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:2.0:1787855883.706563:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2360:x1874702464253568:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855883.706576:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464253440:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 25us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855883.706583:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:2.0:1787855883.706584:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2360:x1874702464253568:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 23us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855883.706590:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00080000:3.0:1787855883.706598:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787855883.706602:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787855883.706605:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855883.900116:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7649a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486281088:0@lo:400:kworker.0 00000100:00100000:3.0:1787855883.900203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855883.900270:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787855883.900277:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7649680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486280960:0@lo:400:kworker.0 00000100:00100000:3.0:1787855883.900302:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855883.900334:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486281088 00000100:00100000:3.0:1787855883.900342:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486281088 00000100:00100000:3.0:1787855883.900391:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486280960 00000100:00100000:3.0:1787855883.900395:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486280960 00000100:00100000:3.0:1787855883.900419:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787855883.900428:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486281088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855883.900484:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486281088:12345-0@lo:400:kworker.0 Request processed in 57us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855883.900491:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787855883.900522:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787855883.900528:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3355a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486280960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855883.900559:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3355a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486280960:12345-0@lo:400:kworker.0 Request processed in 31us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855883.900566:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:3.0:1787855883.900585:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855883.900617:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7649680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486280960:0@lo:400:kworker.0 00000100:00100000:3.0:1787855883.900629:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7649a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486281088:0@lo:400:kworker.0 00000100:00100000:2.0:1787855883.900752:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7648f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486280704:0@lo:400:kworker.0 00000100:00100000:2.0:1787855883.900824:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855883.900857:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486281216:0@lo:400:kworker.0 00000100:00100000:2.0:1787855883.900891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855883.900910:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787855883.900915:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486280832:0@lo:400:kworker.0 00000100:00100000:2.0:1787855883.900937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855883.901266:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486280704 00000100:00100000:3.0:1787855883.901273:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486280704 00000100:00100000:3.0:1787855883.901307:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787855883.901315:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3306:x1874702486280704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855883.901494:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486281216 00000100:00100000:1.0:1787855883.901499:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486281216 00000100:00100000:1.0:1787855883.901537:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787855883.901543:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e748ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486281216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855883.901628:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486280832 00000100:00100000:2.0:1787855883.901632:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486280832 00000100:00100000:2.0:1787855883.901673:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787855883.901681:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e748b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486280832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855883.901736:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3306:x1874702486280704:12345-0@lo:400:kworker.0 Request processed in 420us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855883.901743:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:3.0:1787855883.901819:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787855883.912155:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e748ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486281216:12345-0@lo:400:kworker.0 Request processed in 10601us (11253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855883.912171:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787855883.912312:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e748b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486280832:12345-0@lo:400:kworker.0 Request processed in 10631us (11372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855883.912322:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787855883.912684:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7648f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486280704:0@lo:400:kworker.0 00000100:00100000:0.0:1787855883.912708:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486281216:0@lo:400:kworker.0 00000100:00100000:0.0:1787855883.912739:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486280832:0@lo:400:kworker.0 00010000:00010000:3.0:1787855884.028088:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787855884.156079:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787855884.156092:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787855884.156641:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1787855884.156650:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787855884.357382:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855884.357612:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464253952 00000100:00100000:3.0:1787855884.357624:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464253952 00000100:00100000:3.0:1787855884.357692:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 137 00000100:00100000:3.0:1787855884.357704:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:11295:x1874702464253952:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787855884.357723:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855884.357747:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366df2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616cd6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.357853:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df36 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.357883:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.357897:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.357914:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df3d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.357922:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.357929:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.359644:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366df44 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.359665:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366df44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.359676:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366df44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855884.359688:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787855884.359913:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df36 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.359921:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df36 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.359927:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df36 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.359938:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855884.359943:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df36 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.359950:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df36 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.359963:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a73c7093c00) 00010000:00010000:3.0:1787855884.359966:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855884.359970:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df36 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.359975:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df36 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.359988:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df3d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.359993:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df3d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.359998:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.360002:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855884.360004:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df3d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.360009:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df3d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.360029:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a73d40aca00) 00010000:00010000:3.0:1787855884.360032:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855884.360035:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df3d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.360040:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df3d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.360664:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366df2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cd6 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.360682:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366df44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cd6 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855884.360690:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a73d40ac700) 00010000:00010000:3.0:1787855884.360692:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855884.360695:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229000, rc 0) 00000100:00100000:3.0:1787855884.360889:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:11295:x1874702464253952:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 3186us (3514us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787855884.360899:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 137 00000100:00100000:3.0:1787855884.365520:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855884.365614:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464254080 00000100:00100000:0.0:1787855884.365630:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464254080 00000100:00100000:0.0:1787855884.365706:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 138 00000100:00100000:0.0:1787855884.365718:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3354780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:11295:x1874702464254080:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787855884.365884:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3354780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:11295:x1874702464254080:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 Request processed in 167us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855884.365892:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 138 00000100:00100000:0.0:1787855884.367058:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855884.368889:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464254208 00000100:00100000:2.0:1787855884.368907:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464254208 00000100:00100000:2.0:1787855884.369007:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:2.0:1787855884.369017:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:2358:x1874702464254208:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855884.369037:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855884.369099:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366df44 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cd6 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855884.369141:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a73d40ac700) 00010000:00010000:2.0:1787855884.369148:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855884.369231:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:2358:x1874702464254208:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 216us (2180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855884.370543:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:1.0:1787855884.412384:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa23cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486281344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787855884.412466:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855884.412546:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486281344 00000100:00100000:3.0:1787855884.412559:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486281344 00000100:00100000:3.0:1787855884.412648:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787855884.412662:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787855884.412664:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486281344:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787855884.412679:0:6683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1787855884.412724:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855884.412868:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486281344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 206us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855884.412897:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787855884.413095:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa23cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486281344:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787855885.055349:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787855885.184184:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787855885.184196:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787855885.184732:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1787855885.184741:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787855886.082830:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787855886.085628:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:0.0:1787855886.597846:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855886.597946:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464254336 00000100:00100000:3.0:1787855886.597960:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464254336 00000100:00100000:3.0:1787855886.598062:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 139 00000100:00100000:3.0:1787855886.598074:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:11337:x1874702464254336:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855886.598111:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855886.598141:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616cdd expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787855886.598318:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787855886.598448:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366df59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.598467:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366df59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.598482:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366df59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.598499:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.598507:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.598513:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.599883:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366df59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.599900:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366df59 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.599914:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366df59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.599922:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855886.599927:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366df59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.599936:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366df59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.599955:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:3.0:1787855886.599959:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855886.599965:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366df59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.599971:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366df59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.599984:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.600063:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.600070:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.600076:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855886.600079:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.600105:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.600115:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a73d40aca00) 00010000:00010000:3.0:1787855886.600117:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855886.600121:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df60 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.600127:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.600178:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df52 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cdd expref: 14 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.600718:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:3.0:1787855886.600722:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855886.600727:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cdd expref: 14 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.600740:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228600, rc 0) 00000100:00100000:3.0:1787855886.601038:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:11337:x1874702464254336:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 2964us (3205us total) trans 0 rc 301/301 00000100:00100000:3.0:1787855886.601048:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 139 00000100:00100000:1.0:1787855886.626807:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855886.626897:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464254592 00000100:00100000:0.0:1787855886.626911:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464254592 00000100:00100000:0.0:1787855886.626981:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 140 00000100:00100000:0.0:1787855886.627003:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d8960780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:11337:x1874702464254592:12345-192.168.201.38@tcp:36:lfs.0 00010000:00010000:0.0:1787855886.627097:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855886.627139:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046c00/0x516929ca3366d8d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b16 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855886.627166:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:0.0:1787855886.627173:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787855886.627534:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366df67 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855886.627552:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366df28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ccf expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855886.627562:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366df67 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855886.627609:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366df28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ccf expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855886.627627:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366df28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ccf expref: 5 pid: 5833 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855886.627646:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa23cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486281472:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787855886.627798:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6900 going to sleep for 11 seconds 00000100:00100000:3.0:1787855886.634866:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa23cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486281472:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787855886.634900:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366df67 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855886.639377:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855886.639662:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464254720 00000100:00100000:0.0:1787855886.639676:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464254720 00010000:00010000:0.0:1787855886.639755:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366df28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ccf expref: 6 pid: 5833 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855886.639847:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:0.0:1787855886.639860:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:2358:x1874702464254720:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855886.639881:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855886.639890:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366df28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ccf expref: 6 pid: 5833 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855886.639904:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366df28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ccf expref: 6 pid: 5833 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855886.639933:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366df28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ccf expref: 6 pid: 5833 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855886.639953:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:0.0:1787855886.639960:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366df67 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855886.639970:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366df67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855886.639980:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366df67 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855886.640276:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855886.640351:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2358:x1874702464254720:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 493us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855886.640361:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 61 00010000:00010000:2.0:1787855886.640600:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366df67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.640623:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366df67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.640666:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366df6e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.640678:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366df6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.640687:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366df6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787855886.642045:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1787855886.651466:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787855886.651500:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366df67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.651512:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366df67 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.651520:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366df67 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.651527:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855886.651532:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366df67 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.651540:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366df67 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.651561:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:3.0:1787855886.651565:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855886.651570:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366df67 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.651578:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366df67 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787855886.651604:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c7bc882 reply state 000000001a4e93c9 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366df6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855886.651679:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787855886.651845:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d8960780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:11337:x1874702464254592:12345-192.168.201.38@tcp:36:lfs.0 Request processed in 24848us (25068us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1787855886.651855:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 140 00010000:00010000:2.0:1787855886.662770:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366df6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.662808:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366df6e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.662815:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366df6e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.662819:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855886.662825:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366df6e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.662832:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366df6e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.662852:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a73c7093e00) 00010000:00010000:2.0:1787855886.662855:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855886.662871:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366df6e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.662877:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366df6e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855886.757352:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855886.757475:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464254848 00000100:00100000:3.0:1787855886.757511:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464254848 00000100:00100000:3.0:1787855886.757602:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 141 00000100:00100000:3.0:1787855886.757691:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:11345:x1874702464254848:12345-192.168.201.38@tcp:101:lctl.0 00010000:00010000:3.0:1787855886.757728:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855886.757764:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616ce4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.757891:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.758016:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.758032:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855886.758129:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787855886.758134:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787855886.758171:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.758201:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ce4 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.758221:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ce4 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.758230:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40aca00) 00010000:00010000:3.0:1787855886.758233:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787855886.758237:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228800, rc 0) 00000100:00100000:3.0:1787855886.758329:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:11345:x1874702464254848:12345-192.168.201.38@tcp:101:lctl.0 Request processed in 716us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855886.758338:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 141 00000100:00100000:0.0:1787855886.851347:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855886.851490:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464254976 00000100:00100000:2.0:1787855886.851501:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464254976 00000100:00100000:2.0:1787855886.851574:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 142 00000100:00100000:2.0:1787855886.851585:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:11351:x1874702464254976:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1787855886.851609:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855886.851641:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366df83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616ceb expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.851725:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366df8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.851740:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366df8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.851752:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366df8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.851769:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366df91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.851813:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366df91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.851823:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366df91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852017:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886000/0x516929ca3366df98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852026:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886000/0x516929ca3366df98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852034:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886000/0x516929ca3366df98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855886.852095:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787855886.852099:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787855886.852140:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886000/0x516929ca3366df98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852155:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366df8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852163:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366df8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852171:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366df8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852179:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855886.852184:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366df8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852193:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366df8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852211:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40aca00) 00010000:00010000:2.0:1787855886.852221:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855886.852228:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366df8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852236:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366df8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852255:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366df91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852261:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366df91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852267:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366df91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852273:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855886.852277:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366df91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852284:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366df91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852293:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a73c7093e00) 00010000:00010000:2.0:1787855886.852297:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855886.852300:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366df91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852307:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366df91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852357:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366df83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ceb expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852466:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886000/0x516929ca3366df98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ceb expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.852475:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:2.0:1787855886.852477:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787855886.852480:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7886000, rc 0) 00000100:00100000:2.0:1787855886.852576:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:11351:x1874702464254976:12345-192.168.201.38@tcp:101:bash.0 Request processed in 992us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855886.852588:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 142 00000100:00100000:0.0:1787855886.860591:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855886.866242:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464255232 00000100:00100000:3.0:1787855886.866259:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464255232 00000100:00100000:3.0:1787855886.866346:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 143 00000100:00100000:3.0:1787855886.866358:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+15:11351:x1874702464255232:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1787855886.866382:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855886.866409:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df9f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616cf2 expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.866563:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366dfa6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.866579:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366dfa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.866592:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366dfa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.866673:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dfad lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.866681:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dfad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.866689:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dfad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787855886.867313:0:9629:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787855886.867494:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dfb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.867513:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.867525:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dfb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.867562:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366dfa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.867570:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366dfa6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.867577:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366dfa6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.867583:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855886.867587:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366dfa6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.867596:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366dfa6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.867610:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:3.0:1787855886.867613:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855886.867618:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366dfa6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.867624:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366dfa6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787855886.867637:0:9629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bcff827 reply state 0000000032a92e6d transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dfad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855886.867655:0:9629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787855886.867692:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366df9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf2 expref: 18 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.867707:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf2 expref: 17 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.867715:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73d40ac900) 00010000:00010000:3.0:1787855886.867717:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787855886.867719:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229000, rc 0) 00000100:00100000:3.0:1787855886.867816:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:11351:x1874702464255232:12345-192.168.201.38@tcp:101:bash.0 Request processed in 1459us (7241us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1787855886.867824:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 143 00010000:00010000:3.0:1787855886.875969:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dfad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.875987:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dfad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.875994:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dfad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.876000:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855886.876005:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dfad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.876013:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dfad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.876051:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73d40acb00) 00010000:00010000:3.0:1787855886.876055:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855886.876060:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dfad lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.876067:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228e00/0x516929ca3366dfad lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855886.878599:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855886.878753:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464255360 00000100:00100000:3.0:1787855886.878765:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464255360 00000100:00100000:3.0:1787855886.878870:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:3.0:1787855886.878937:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2358:x1874702464255360:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1787855886.878957:0:8077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855886.878980:0:8077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366dfc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616cf9 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787855886.879007:0:8077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787855886.879028:0:8077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1787855886.879032:0:8077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855886.879042:0:8077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366dfc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf9 expref: 6 pid: 8077 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.879060:0:8077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366dfc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf9 expref: 6 pid: 8077 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.879072:0:8077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166d600, rc 0) 00000100:00100000:3.0:1787855886.879136:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2358:x1874702464255360:12345-192.168.201.38@tcp:101:bash.0 Request processed in 204us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855886.879156:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00080000:1.0:1787855886.879241:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787855886.893687:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855886.895515:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464255488 00000100:00100000:3.0:1787855886.895529:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464255488 00000100:00100000:3.0:1787855886.895599:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:3.0:1787855886.895609:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:11351:x1874702464255488:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1787855886.895628:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855886.895647:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d00 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.895677:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366dfc2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf9 expref: 7 pid: 8077 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.895687:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855886.895691:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855886.895697:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d00 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.895733:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366dfc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf9 expref: 7 pid: 8077 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.895747:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366dfc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf9 expref: 7 pid: 8077 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855886.895762:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3357480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6679:1874702486281600:192.168.201.38@tcp:104: 00000100:00100000:3.0:1787855886.895873:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73f7880480 going to sleep for 11 seconds 00000100:00100000:3.0:1787855886.902260:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3357480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6679:1874702486281600:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787855886.902324:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d00 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855886.902358:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166d000, rc 0) 00000100:00100000:3.0:1787855886.902467:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:11351:x1874702464255488:12345-192.168.201.38@tcp:101:bash.0 Request processed in 6857us (8789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855886.902478:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:0.0:1787855886.906118:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855886.906265:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464255616 00000100:00100000:2.0:1787855886.906280:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464255616 00010000:00010000:2.0:1787855886.906337:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366dfc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf9 expref: 7 pid: 8077 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855886.906395:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:2.0:1787855886.906405:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2357:x1874702464255616:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855886.906422:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855886.906446:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366dfc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf9 expref: 7 pid: 8077 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.906461:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366dfc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf9 expref: 7 pid: 8077 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.906486:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366dfc2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf9 expref: 7 pid: 8077 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.906524:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855886.906541:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855886.906551:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d00 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.906562:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d00 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855886.906607:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d00 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855886.906623:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7488000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1874702486281728:192.168.201.38@tcp:105: 00000100:00100000:0.0:1787855886.907236:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80fa900 going to sleep for 11 seconds 00000100:00100000:1.0:1787855886.917287:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855886.917385:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464255872 00000100:00100000:2.0:1787855886.917408:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464255872 00000100:00100000:0.0:1787855886.917490:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7488000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1874702486281728:192.168.201.38@tcp:105: 00010000:00010000:0.0:1787855886.917523:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855886.917567:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:2.0:1787855886.917578:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+17:11351:x1874702464255872:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:0.0:1787855886.917608:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464255616:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 11201us (11523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855886.917621:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:2.0:1787855886.918057:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:11351:x1874702464255872:12345-192.168.201.38@tcp:35:bash.0 Request processed in 479us (778us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787855886.918066:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:2.0:1787855887.076446:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855887.079724:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464256128 00000100:00100000:3.0:1787855887.079755:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464256128 00000100:00100000:3.0:1787855887.080194:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 144 00000100:00100000:3.0:1787855887.081438:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e748a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:11361:x1874702464256128:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855887.081482:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855887.081513:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366dfd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d07 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855887.082434:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787855887.082759:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366dfd0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d07 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.082810:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40aca00) 00010000:00010000:3.0:1787855887.082814:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787855887.082821:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366dfd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d07 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.082841:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166c000, rc 0) 00000100:00100000:3.0:1787855887.083189:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e748a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:11361:x1874702464256128:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 2176us (6921us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1787855887.083228:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 144 00000100:00100000:1.0:1787855887.088676:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855887.089064:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464256384 00000100:00100000:3.0:1787855887.089085:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464256384 00000100:00100000:3.0:1787855887.089156:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:3.0:1787855887.089168:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9732940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:11361:x1874702464256384:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1787855887.089549:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9732940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+20:11361:x1874702464256384:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 382us (888us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787855887.089558:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 37 00010000:00010000:1.0:1787855887.100483:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855887.195159:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855887.195500:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464256512 00000100:00100000:3.0:1787855887.195514:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464256512 00000100:00100000:2.0:1787855887.199441:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 145 00000100:00100000:2.0:1787855887.199476:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9730f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+20:11367:x1874702464256512:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1787855887.199517:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855887.201396:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366dfde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d0e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.201541:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366dfe5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.201563:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366dfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.202551:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366dfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855887.203416:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787855887.203424:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787855887.203464:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366dfe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.203524:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366dfde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d0e expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.203555:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366dfe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d0e expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.203567:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:2.0:1787855887.204493:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787855887.204500:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7886200, rc 0) 00000100:00100000:2.0:1787855887.206390:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9730f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:11367:x1874702464256512:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 6109us (10426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855887.206409:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 145 00000100:00100000:0.0:1787855887.214192:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855887.214974:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464256768 00000100:00100000:3.0:1787855887.214989:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464256768 00000100:00100000:3.0:1787855887.215141:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 146 00000100:00100000:3.0:1787855887.215154:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:11367:x1874702464256768:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855887.215199:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855887.215229:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366dfec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d15 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.215410:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366dff3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.215429:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366dff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.215443:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366dff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855887.215456:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787855887.215640:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366dfec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d15 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.215664:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366dff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d15 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.215675:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73d40ac900) 00010000:00010000:3.0:1787855887.215679:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787855887.215695:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166ce00, rc 0) 00000100:00100000:3.0:1787855887.221933:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+23:11367:x1874702464256768:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 6761us (7745us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1787855887.221952:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 146 00000100:00100000:1.0:1787855887.244138:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855887.244519:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464257024 00000100:00100000:3.0:1787855887.244534:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464257024 00000100:00100000:3.0:1787855887.244628:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 147 00000100:00100000:3.0:1787855887.244642:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c97312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+23:11367:x1874702464257024:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855887.244677:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855887.244716:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e001 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d1c expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855887.244835:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855887.245237:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464257152 00000100:00100000:0.0:1787855887.245243:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464257152 00000100:00100000:0.0:1787855887.245294:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:0.0:1787855887.245303:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df807840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+24:2357:x1874702464257152:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855887.245319:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855887.245415:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366dff3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d15 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.245608:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73d40ac900) 00010000:00010000:0.0:1787855887.245614:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855887.247036:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df807840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+24:2357:x1874702464257152:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1726us (2192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855887.247049:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00010000:00010000:1.0:1787855887.247545:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e008 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855887.247567:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e008 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855887.247614:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e008 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855887.247631:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787855887.248068:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e001 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d1c expref: 25 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855887.248105:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e008 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d1c expref: 24 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855887.248116:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73d40ac900) 00010000:00010000:1.0:1787855887.248119:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787855887.248123:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ffa00, rc 0) 00000100:00100000:1.0:1787855887.248413:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c97312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+24:11367:x1874702464257024:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 3773us (4288us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1787855887.248484:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 147 00000100:00100000:1.0:1787855887.271392:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855887.271627:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464257280 00000100:00100000:3.0:1787855887.271642:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464257280 00000100:00100000:3.0:1787855887.271737:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:3.0:1787855887.271750:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df806d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2359:x1874702464257280:12345-192.168.201.38@tcp:1:lfs.0 00010000:00010000:3.0:1787855887.272290:0:8077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e016 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.272319:0:8077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d00 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.272413:0:8077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787855887.272547:0:8077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787855887.272554:0:8077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e016 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.272613:0:8077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d00 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.272633:0:8077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d00 expref: 6 pid: 6679 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855887.272653:0:8077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3357480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8077:1874702486281856:192.168.201.38@tcp:104: 00000100:00100000:2.0:1787855887.273634:0:8077:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73f78806c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855887.286014:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855887.286753:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464257408 00000100:00100000:3.0:1787855887.286767:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464257408 00002000:00100000:3.0:1787855887.286895:0:6686:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9a73df805680 x1874702464257408/t0(0) o4->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:43/0 lens 504/0 e 0 to 0 dl 1787855898 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787855887.286909:0:6686:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73df805680 with x1874702464257408 ext(0->12) 00010000:00010000:3.0:1787855887.286922:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d00 expref: 7 pid: 6679 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.286946:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d00 expref: 7 pid: 6679 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787855887.286956:0:6686:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a73df805680 00000100:00100000:3.0:1787855887.287024:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:3.0:1787855887.287036:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df805680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2358:x1874702464257408:12345-192.168.201.38@tcp:4:lfs.0 00000100:00100000:3.0:1787855887.290565:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df805680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2358:x1874702464257408:12345-192.168.201.38@tcp:4:lfs.0 Request processed in 3516us (4551us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787855887.292670:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00002000:00100000:3.0:1787855887.292697:0:6686:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9a73df805680 x1874702464257408/t4294967305(0) o4->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:43/0 lens 504/448 e 0 to 0 dl 1787855898 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787855887.292712:0:6686:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73df805680 with x1874702464257408 ext(0->12) 00010000:00010000:3.0:1787855887.293643:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d00 expref: 9 pid: 6679 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.293675:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d00 expref: 9 pid: 6679 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787855887.294044:0:6686:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a73df805680 00000100:00100000:2.0:1787855887.294250:0:8077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3357480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8077:1874702486281856:192.168.201.38@tcp:104: 00010000:00010000:2.0:1787855887.294489:0:8077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e016 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855887.306086:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855887.306584:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464257536 00000100:00100000:0.0:1787855887.306598:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464257536 00010000:00010000:0.0:1787855887.306657:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d00 expref: 9 pid: 6679 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855887.306954:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:0.0:1787855887.307025:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2358:x1874702464257536:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855887.307064:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787855887.307098:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787855887.307102:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787855887 00002000:00010000:0.0:1787855887.307105:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787855887 00002000:00010000:0.0:1787855887.307107:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787855887 00010000:00010000:0.0:1787855887.307116:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d00 expref: 9 pid: 6679 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.307133:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d00 expref: 9 pid: 6679 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.307491:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000974e779f/0x516929ca3366dfc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d00 expref: 9 pid: 6679 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.307519:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787855887.307524:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787855887.307532:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.307545:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e016 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.307945:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855887.308044:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2358:x1874702464257536:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1023us (1983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855887.308055:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 63 00010000:00010000:3.0:1787855887.309641:0:8077:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.309667:0:8077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.309724:0:8077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e016 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.309735:0:8077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e016 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.309762:0:8077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e016 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.309771:0:8077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166c000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787855887.309920:0:8077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e016 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.309935:0:8077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e016 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.309971:0:8077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e016 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855887.309981:0:8077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e016 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855887.310117:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df806d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2359:x1874702464257280:12345-192.168.201.38@tcp:1:lfs.0 Request processed in 38364us (38734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855887.310128:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:1.0:1787855887.312695:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855887.313052:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464257792 00000100:00100000:3.0:1787855887.313066:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464257792 00000100:00100000:3.0:1787855887.313161:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:3.0:1787855887.313182:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73dc263050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+24:11367:x1874702464257792:12345-192.168.201.38@tcp:35:lfs.0 00000004:00010000:3.0:1787855887.313277:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e008 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d1c expref: 24 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787855887.314578:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1787855887.314659:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787855887.322709:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1787855887.323543:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e01d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.323666:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dfb4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf2 expref: 28 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.323687:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e01d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.323744:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf2 expref: 28 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.323766:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dfb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf2 expref: 28 pid: 9629 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855887.324043:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa23f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874702486281984:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787855887.324715:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855887.330046:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa23f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874702486281984:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855887.330098:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e01d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855887.332017:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855887.332658:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464257920 00000100:00100000:0.0:1787855887.332673:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464257920 00010000:00010000:0.0:1787855887.332746:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dfb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf2 expref: 29 pid: 9629 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855887.332835:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:0.0:1787855887.332846:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c5548c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+29:2358:x1874702464257920:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855887.332889:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855887.332897:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dfb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf2 expref: 29 pid: 9629 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.332913:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dfb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf2 expref: 29 pid: 9629 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.332945:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366dfb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cf2 expref: 29 pid: 9629 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.332965:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73d40ac900) 00010000:00010000:0.0:1787855887.332970:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e01d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.332981:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e01d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.332990:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e01d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.333018:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855887.333109:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c5548c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+28:2358:x1874702464257920:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 264us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855887.333118:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00010000:00010000:2.0:1787855887.334148:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e01d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.334164:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e01d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787855887.334359:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787855887.335109:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1787855887.335260:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7489a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874702486282112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787855887.335679:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855887.335941:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486282112 00000100:00100000:0.0:1787855887.335952:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486282112 00000100:00100000:0.0:1787855887.336034:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787855887.336046:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e748a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1874702486282112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1787855887.336235:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787855887.341049:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e748a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1874702486282112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 4992us (5358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855887.341096:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787855887.342181:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80fa000 going to sleep for 11 seconds 00000100:00100000:2.0:1787855887.342254:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7489a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874702486282112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787855887.344175:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787855887.344666:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7489a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874702486282240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787855887.345551:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855887.345882:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80fa780 going to sleep for 11 seconds 00000100:00100000:1.0:1787855887.346529:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486282240 00000100:00100000:1.0:1787855887.346541:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486282240 00000100:00100000:1.0:1787855887.346873:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787855887.346887:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e748b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874702486282240:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787855887.347258:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e748b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1874702486282240:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 374us (1710us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787855887.347870:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7489a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874702486282240:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787855887.347999:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1787855887.348065:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e01d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.348090:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e01d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.348114:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e01d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.348121:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855887.348126:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e01d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.348135:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e01d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.348155:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73d40ac900) 00010000:00010000:2.0:1787855887.348159:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787855887.348164:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e01d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.348182:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e01d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787855887.349086:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:1.0:1787855887.349759:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000040:00080000:2.0:1787855887.350186:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1787855887.350769:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 378202991687ns, next at 379202985850ns, rc = 0 00000001:00080000:2.0:1787855887.350808:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787855887.350906:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73d40ac900) 00010000:00010000:2.0:1787855887.350912:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787855887.350925:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e008 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d1c expref: 32 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855887.351127:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73dc263050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+31:11367:x1874702464257792:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 37955us (38460us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787855887.351856:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 38 00000020:00080000:2.0:1787855887.351865:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787855887.363227:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855887.363670:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464258048 00000100:00100000:2.0:1787855887.364847:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464258048 00000100:00100000:2.0:1787855887.364966:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 148 00000100:00100000:2.0:1787855887.364980:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+31:11367:x1874702464258048:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1787855887.365015:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855887.365048:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e024 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d23 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.365147:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e024 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d23 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.365165:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e024 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d23 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.365189:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:2.0:1787855887.365192:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787855887.365198:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887e00, rc 0) 00000100:00100000:2.0:1787855887.368967:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+32:11367:x1874702464258048:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 3971us (5738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855887.368985:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 148 00000100:00100000:0.0:1787855887.370103:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855887.370249:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464258304 00000100:00100000:2.0:1787855887.370264:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464258304 00000100:00100000:2.0:1787855887.371634:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:2.0:1787855887.371649:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+32:11367:x1874702464258304:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:2.0:1787855887.372025:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+33:11367:x1874702464258304:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 378us (1927us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787855887.372034:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:1.0:1787855887.511386:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855887.511559:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464258560 00000100:00100000:2.0:1787855887.511581:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464258560 00000100:00100000:2.0:1787855887.511660:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 149 00000100:00100000:2.0:1787855887.511673:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+33:11377:x1874702464258560:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1787855887.511720:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855887.511755:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e02b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d2a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855887.511955:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787855887.512158:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e02b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d2a expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.512178:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40aca00) 00010000:00010000:2.0:1787855887.512182:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787855887.512189:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e02b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d2a expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.512207:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887a00, rc 0) 00000100:00100000:2.0:1787855887.512485:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+34:11377:x1874702464258560:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 608us (907us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1787855887.512494:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 149 00000100:00100000:1.0:1787855887.531656:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855887.532002:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464258688 00000100:00100000:3.0:1787855887.532016:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464258688 00000100:00100000:3.0:1787855887.532510:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 150 00000100:00100000:3.0:1787855887.532524:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+34:11377:x1874702464258688:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:2.0:1787855887.540845:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e039 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.540900:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e039 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.540916:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e039 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.540938:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e040 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.540945:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.540952:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541120:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e047 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541130:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541138:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787855887.541659:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541742:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e039 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541751:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e039 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541772:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e039 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541820:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855887.541826:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e039 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541835:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e039 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541852:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:2.0:1787855887.541855:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855887.541861:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e039 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541868:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e039 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541885:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541891:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e040 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541897:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e040 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541903:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855887.541906:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e040 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541923:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e040 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541931:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73c7093900) 00010000:00010000:2.0:1787855887.541933:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855887.541936:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e040 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541943:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e040 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541960:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e047 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541967:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e047 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541974:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e047 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541978:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855887.541981:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e047 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541986:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e047 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.541993:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:2.0:1787855887.541996:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855887.541998:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e047 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.542013:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e047 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855887.542162:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+34:11377:x1874702464258688:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 9634us (10591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855887.545560:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 150 00000100:00100000:0.0:1787855887.554672:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855887.554857:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464258944 00000100:00100000:2.0:1787855887.554872:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464258944 00000100:00100000:2.0:1787855887.554951:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:2.0:1787855887.554965:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+34:11377:x1874702464258944:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:2.0:1787855887.555722:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+35:11377:x1874702464258944:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 758us (1061us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787855887.555733:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:1.0:1787855887.614721:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855887.614808:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464259200 00000100:00100000:2.0:1787855887.614822:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464259200 00000100:00100000:2.0:1787855887.614905:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 151 00000100:00100000:2.0:1787855887.614917:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+35:11380:x1874702464259200:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1787855887.614950:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855887.614981:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e04e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d31 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615115:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e055 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615133:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e055 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615172:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e055 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615191:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e05c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615198:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e05c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615205:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e05c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615396:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e063 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615406:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615518:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e063 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855887.615531:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787855887.615753:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e055 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615762:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e055 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615768:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e055 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615828:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855887.615840:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e055 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615848:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e055 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615864:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:2.0:1787855887.615868:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855887.615873:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e055 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615880:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e055 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615897:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e05c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615903:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e05c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615909:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e05c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615915:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855887.615918:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e05c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615923:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e05c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615930:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73c7093900) 00010000:00010000:2.0:1787855887.615933:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855887.615941:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e05c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615946:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e05c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.615998:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e04e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d31 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.616014:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e063 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d31 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.616022:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:2.0:1787855887.616024:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787855887.616026:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887200, rc 0) 00000100:00100000:2.0:1787855887.616117:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+37:11380:x1874702464259200:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1201us (1410us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787855887.616126:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 151 00000100:00100000:1.0:1787855887.624910:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855887.625121:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464259328 00000100:00100000:2.0:1787855887.625133:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464259328 00000100:00100000:2.0:1787855887.625223:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 152 00000100:00100000:2.0:1787855887.625236:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+37:11380:x1874702464259328:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:2.0:1787855887.625342:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e071 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.625364:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.625380:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.625560:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.625568:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e071 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.625575:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.625581:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855887.625586:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.625596:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e071 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.625612:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:2.0:1787855887.625616:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787855887.625621:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e071 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.625627:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e071 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855887.625941:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+37:11380:x1874702464259328:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 706us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855887.625950:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 152 00000100:00100000:0.0:1787855887.630082:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855887.630269:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464259584 00000100:00100000:1.0:1787855887.630282:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464259584 00000100:00100000:1.0:1787855887.630365:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:1.0:1787855887.630377:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+37:11380:x1874702464259584:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1787855887.630720:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+38:11380:x1874702464259584:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 344us (666us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787855887.630729:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:1.0:1787855887.920563:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855887.921056:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464259840 00000100:00100000:2.0:1787855887.921093:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464259840 00000100:00100000:2.0:1787855887.921197:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 153 00000100:00100000:2.0:1787855887.921227:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+38:11411:x1874702464259840:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:2.0:1787855887.921258:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855887.921285:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e078 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d38 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.921409:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e07f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.921428:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e07f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.921442:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e07f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855887.921454:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787855887.921632:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e078 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d38 expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.921653:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e07f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d38 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855887.921662:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:2.0:1787855887.921665:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787855887.921669:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7886e00, rc 0) 00000100:00100000:2.0:1787855887.921756:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+40:11411:x1874702464259840:12345-192.168.201.38@tcp:101:cat.0 Request processed in 531us (1210us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787855887.921764:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 153 00000100:00100000:2.0:1787855887.925795:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855887.927273:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464259968 00000100:00100000:0.0:1787855887.927290:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464259968 00000100:00100000:0.0:1787855887.927419:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:0.0:1787855887.927431:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7488000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+40:2359:x1874702464259968:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855887.927455:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855887.927490:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e07f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d38 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855887.927513:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:0.0:1787855887.927518:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855887.927599:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7488000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+39:2359:x1874702464259968:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 170us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855887.927619:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:1.0:1787855887.927810:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855887.927841:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464260224 00000100:00100000:1.0:1787855887.927845:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464260224 00000100:00100000:1.0:1787855887.927877:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:1.0:1787855887.927885:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+39:11411:x1874702464260224:12345-192.168.201.38@tcp:35:cat.0 00000100:00100000:1.0:1787855887.928185:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+40:11411:x1874702464260224:12345-192.168.201.38@tcp:35:cat.0 Request processed in 300us (373us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787855887.928193:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:3.0:1787855888.030274:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855888.033865:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464260480 00000100:00100000:0.0:1787855888.033897:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464260480 00000100:00100000:0.0:1787855888.034008:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 154 00000100:00100000:0.0:1787855888.034024:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3357c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+40:11417:x1874702464260480:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:0.0:1787855888.034071:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855888.034075:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787855888.034112:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366dfe5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d0e expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.034160:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:0.0:1787855888.034167:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787855888.034189:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e08d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d3f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.034315:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e094 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.034330:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e063 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d31 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.034340:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e094 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.034381:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e063 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d31 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.034397:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e063 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d31 expref: 40 pid: 5834 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855888.034412:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa23c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486282368:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787855888.034559:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6d80 going to sleep for 11 seconds 00000100:00080000:1.0:1787855888.035094:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855888.051829:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855888.052078:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa23c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486282368:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855888.052118:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e094 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855888.052309:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464260608 00000100:00100000:2.0:1787855888.052336:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464260608 00010000:00010000:2.0:1787855888.052389:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e063 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d31 expref: 41 pid: 5834 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855888.052428:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:2.0:1787855888.052439:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+41:2358:x1874702464260608:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855888.052462:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855888.052470:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e063 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d31 expref: 41 pid: 5834 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.052486:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e063 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d31 expref: 41 pid: 5834 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.052516:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e063 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d31 expref: 41 pid: 5834 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.052541:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:2.0:1787855888.052546:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e094 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.052559:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e094 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.052569:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e094 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.052603:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855888.052687:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+40:2358:x1874702464260608:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 249us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855888.052704:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00010000:00010000:0.0:1787855888.053350:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e094 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.053371:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e094 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855888.053398:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787855888.053624:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e08d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d3f expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.053651:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e094 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d3f expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.053660:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:0.0:1787855888.053663:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787855888.053678:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143800, rc 0) 00000100:00100000:0.0:1787855888.053732:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3357c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+40:11417:x1874702464260480:12345-192.168.201.38@tcp:101:dd.0 Request processed in 19713us (23472us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787855888.053740:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 154 00000100:00100000:1.0:1787855888.058274:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855888.058366:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464260864 00000100:00100000:0.0:1787855888.058383:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464260864 00000100:00100000:0.0:1787855888.058456:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 155 00000100:00100000:0.0:1787855888.058469:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+40:11417:x1874702464260864:12345-192.168.201.38@tcp:36:dd.0 00010000:00010000:0.0:1787855888.058855:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e0a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.058884:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.058896:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787855888.058966:0:9629:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1787855888.058991:0:9629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000cb762d3 reply state 00000000399cb66f transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855888.059001:0:9629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787855888.059117:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+43:11417:x1874702464260864:12345-192.168.201.38@tcp:36:dd.0 Request processed in 650us (859us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1787855888.059126:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 155 00000020:00080000:0.0:1787855888.059132:0:9629:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787855888.062346:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.062368:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e0a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.062377:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e0a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.062383:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855888.062389:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e0a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.062397:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e0a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.062420:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:2.0:1787855888.062423:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855888.062428:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e0a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.062434:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e0a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855888.125849:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855888.475533:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855888.476590:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464260992 00000100:00100000:0.0:1787855888.476607:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464260992 00000100:00100000:0.0:1787855888.476704:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 156 00000100:00100000:0.0:1787855888.476717:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+42:11431:x1874702464260992:12345-192.168.201.38@tcp:101:stat.0 00010000:00010000:0.0:1787855888.476747:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855888.476812:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e0a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d46 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.476903:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e0b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.476921:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.476938:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.476957:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e0b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.476991:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.476999:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.477139:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e0be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.477152:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e094 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d3f expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.477162:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e0be lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.477224:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e094 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d3f expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855888.477242:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e094 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d3f expref: 43 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855888.477260:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa23c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874702486282496:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787855888.477391:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855888.480607:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855888.480811:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464261248 00000100:00100000:3.0:1787855888.480822:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464261248 00000100:00100000:0.0:1787855888.480998:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa23c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874702486282496:192.168.201.38@tcp:104: 00000100:00100000:3.0:1787855888.481000:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:3.0:1787855888.481013:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+44:5595:x1874702464261248:12345-192.168.201.38@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1787855888.481036:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e0be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855888.481409:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+45:5595:x1874702464261248:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 398us (814us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787855888.481416:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:1.0:1787855888.483457:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855888.483648:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464261376 00000100:00100000:2.0:1787855888.483661:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464261376 00010000:00010000:2.0:1787855888.483705:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e094 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d3f expref: 45 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855888.483813:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:2.0:1787855888.483837:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+45:2358:x1874702464261376:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855888.483856:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855888.483873:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e094 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d3f expref: 45 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.483885:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e094 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d3f expref: 45 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.483911:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e094 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d3f expref: 45 pid: 5833 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.483945:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:2.0:1787855888.483951:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e0be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.483962:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e0be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.483971:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e0be lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.484004:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855888.484062:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+44:2358:x1874702464261376:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 225us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855888.484068:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 66 00010000:00010000:3.0:1787855888.484127:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e0be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484137:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e0be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855888.484201:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787855888.484206:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787855888.484227:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e0be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484240:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e0be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484258:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484263:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e0b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484268:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e0b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484272:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855888.484275:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e0b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484281:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e0b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484287:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:3.0:1787855888.484289:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855888.484292:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e0b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484296:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e0b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484304:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484309:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e0b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484313:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484323:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855888.484326:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484332:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e0b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484343:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73f49fbc00) 00010000:00010000:3.0:1787855888.484346:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855888.484348:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e0b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484354:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e0b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484396:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e0a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d46 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484412:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e0be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d46 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.484418:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:3.0:1787855888.484420:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787855888.484422:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142400, rc 0) 00000100:00100000:3.0:1787855888.484451:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+43:11431:x1874702464260992:12345-192.168.201.38@tcp:101:stat.0 Request processed in 7738us (8935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855888.484459:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 156 00000100:00100000:3.0:1787855888.512853:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787855888.515414:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486282624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855888.515531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855888.515646:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486282624 00000100:00100000:3.0:1787855888.515656:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486282624 00000100:00100000:3.0:1787855888.515739:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787855888.515752:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486282624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787855888.515823:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787855888.516627:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787855888.517048:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486282624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1294us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855888.517071:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787855888.517610:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486282624:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787855888.553546:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1787855888.553586:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1787855888.568251:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855888.568486:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464261632 00000100:00100000:1.0:1787855888.568499:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464261632 00000100:00100000:1.0:1787855888.568581:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 157 00000100:00100000:1.0:1787855888.568594:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+43:11437:x1874702464261632:12345-192.168.201.38@tcp:36:truncate.0 00010000:00010000:1.0:1787855888.568683:0:9629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855888.568719:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e0be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d46 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855888.568744:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:1.0:1787855888.568751:0:9629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787855888.569387:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e0c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855888.569405:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e0c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855888.569418:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e0c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787855888.569470:0:9629:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787855888.569494:0:9629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007476d8aa reply state 00000000ccae04fd transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e0c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855888.569505:0:9629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787855888.569674:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+45:11437:x1874702464261632:12345-192.168.201.38@tcp:36:truncate.0 Request processed in 1080us (1436us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787855888.569684:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 157 00000020:00080000:1.0:1787855888.569692:0:9629:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787855888.571816:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e0c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.571838:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e0c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.571846:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e0c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.571853:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fec00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855888.571860:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e0c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.571869:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e0c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.571888:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:3.0:1787855888.571892:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855888.571897:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e0c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855888.571924:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e0c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855888.800381:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855888.800534:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464261760 00000100:00100000:2.0:1787855888.800548:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464261760 00000100:00100000:2.0:1787855888.800633:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 158 00000100:00100000:2.0:1787855888.800647:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+44:11451:x1874702464261760:12345-192.168.201.38@tcp:101:stat.0 00010000:00010000:2.0:1787855888.800699:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855888.800736:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e0cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d4d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.800843:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.800861:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.800875:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.800893:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e0da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.800900:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e0da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.800907:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e0da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801033:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e0e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801043:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801083:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855888.801128:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787855888.801140:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787855888.801245:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801259:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801270:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801277:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801284:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801291:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855888.801296:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801305:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801319:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:2.0:1787855888.801322:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855888.801327:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801334:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801351:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e0da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801367:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e0da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801373:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e0da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801378:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855888.801381:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e0da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801386:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e0da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801393:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73c7093900) 00010000:00010000:2.0:1787855888.801395:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855888.801398:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e0da lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801403:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e0da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801438:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e0cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d4d expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801452:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d4d expref: 45 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.801460:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:2.0:1787855888.801462:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787855888.801470:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7886400, rc 0) 00000100:00100000:2.0:1787855888.801562:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+45:11451:x1874702464261760:12345-192.168.201.38@tcp:101:stat.0 Request processed in 917us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855888.801571:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 158 00000100:00100000:1.0:1787855888.808194:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855888.808241:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855888.808279:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855888.808324:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855888.808345:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464261888 00000100:00100000:0.0:1787855888.808356:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464261888 00000100:00100000:3.0:1787855888.808403:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464262016 00000100:00100000:3.0:1787855888.808409:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464262016 00000100:00100000:0.0:1787855888.808421:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 295 00000100:00100000:0.0:1787855888.808432:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2357:x1874702464261888:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855888.808464:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464262144 00000100:00100000:3.0:1787855888.808468:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464262144 00000100:00100000:3.0:1787855888.808497:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:3.0:1787855888.808506:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464262016:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855888.808515:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2357:x1874702464261888:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855888.808521:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 295 00000100:00100000:3.0:1787855888.808550:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2357:x1874702464262016:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 46us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855888.808559:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:3.0:1787855888.808576:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:3.0:1787855888.808583:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464262144:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855888.808608:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2357:x1874702464262144:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855888.808615:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00080000:3.0:1787855888.808633:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787855888.808638:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787855888.808718:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464262272 00000100:00100000:2.0:1787855888.808723:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464262272 00000100:00100000:2.0:1787855888.808813:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 158 00000100:00100000:2.0:1787855888.808821:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464262272:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855888.808858:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2357:x1874702464262272:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 39us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855888.808864:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 158 00000100:00080000:3.0:1787855888.809037:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855888.977470:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855888.978060:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464262528 00000100:00100000:2.0:1787855888.978074:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464262528 00000100:00100000:2.0:1787855888.978173:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 159 00000100:00100000:2.0:1787855888.978417:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+45:11462:x1874702464262528:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1787855888.978447:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855888.978478:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e0e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d54 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855888.978639:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787855888.978842:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e0e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d54 expref: 47 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.978861:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40aca00) 00010000:00010000:2.0:1787855888.978864:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787855888.978871:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e0e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d54 expref: 47 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855888.978913:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7886c00, rc 0) 00000100:00100000:2.0:1787855888.979006:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+46:11462:x1874702464262528:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 821us (1550us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787855888.979016:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 159 00000100:00100000:0.0:1787855888.983463:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855888.983901:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464262784 00000100:00100000:1.0:1787855888.983916:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464262784 00000100:00100000:1.0:1787855888.983998:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:1.0:1787855888.984010:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73dc262850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+46:11462:x1874702464262784:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1787855888.984399:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73dc262850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+47:11462:x1874702464262784:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 389us (950us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787855888.984408:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:3.0:1787855889.022690:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c33552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486282880:0@lo:400:kworker.0 00000100:00100000:3.0:1787855889.022812:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855889.022897:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787855889.022903:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486283008:0@lo:400:kworker.0 00000100:00100000:3.0:1787855889.022925:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855889.022984:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486282880 00000100:00100000:3.0:1787855889.022993:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486282880 00000100:00100000:3.0:1787855889.023059:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486283008 00000100:00100000:3.0:1787855889.023062:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486283008 00000100:00100000:3.0:1787855889.023096:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787855889.023105:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7649a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486282880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855889.023177:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7649a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486282880:12345-0@lo:400:kworker.0 Request processed in 72us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855889.023292:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486283136:0@lo:400:kworker.0 00000100:00100000:2.0:1787855889.023326:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855889.023342:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787855889.023347:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c3356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486282752:0@lo:400:kworker.0 00000100:00100000:2.0:1787855889.023376:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855889.023400:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7648f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486283264:0@lo:400:kworker.0 00000100:00100000:2.0:1787855889.023425:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855889.023453:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486283136 00000100:00100000:2.0:1787855889.023456:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486283136 00000100:00100000:2.0:1787855889.023480:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787855889.023487:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486283008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855889.023520:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486283008:12345-0@lo:400:kworker.0 Request processed in 34us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855889.023527:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787855889.023546:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787855889.023551:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7488f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486283136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855889.023580:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7488f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486283136:12345-0@lo:400:kworker.0 Request processed in 29us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855889.023586:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787855889.023633:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486283136:0@lo:400:kworker.0 00000100:00080000:2.0:1787855889.023693:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855889.023724:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486282752 00000100:00100000:2.0:1787855889.023728:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486282752 00000100:00100000:2.0:1787855889.023755:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787855889.023762:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486282752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855889.023828:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3304:x1874702486282752:12345-0@lo:400:kworker.0 Request processed in 67us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855889.023835:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787855889.023872:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486283008:0@lo:400:kworker.0 00000100:00100000:2.0:1787855889.023885:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c33552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486282880:0@lo:400:kworker.0 00000100:00100000:2.0:1787855889.023931:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c3356580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b2adc339-cccb-4166-8f83-87a1e9e399f1:3304:1874702486282752:0@lo:400:kworker.0 00000100:00100000:2.0:1787855889.023968:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486283264 00000100:00100000:2.0:1787855889.023971:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486283264 00000100:00100000:2.0:1787855889.024006:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787855889.024013:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e748b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486283264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855889.024068:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e748b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486283264:12345-0@lo:400:kworker.0 Request processed in 55us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855889.024074:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1787855889.024088:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787855889.024103:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1787855889.024109:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1787855889.024127:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7648f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486283264:0@lo:400:kworker.0 00000100:00100000:3.0:1787855889.024536:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00010000:00010000:1.0:1787855889.148015:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855889.172140:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855889.172323:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464263040 00000100:00100000:2.0:1787855889.172338:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464263040 00000100:00100000:2.0:1787855889.172420:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 160 00000100:00100000:2.0:1787855889.172454:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+47:11468:x1874702464263040:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1787855889.172491:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855889.172521:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e0f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d5b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.172655:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.172680:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e0e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d4d expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.172691:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0fd lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.172731:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d4d expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.172747:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e0e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d4d expref: 48 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855889.172765:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7489a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486283392:192.168.201.38@tcp:104: 00000100:00100000:2.0:1787855889.172926:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e74ac840 going to sleep for 11 seconds 00000100:00100000:2.0:1787855889.182488:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855889.182999:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464263168 00000100:00100000:1.0:1787855889.183013:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464263168 00010000:00010000:1.0:1787855889.183090:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e0e1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d4d expref: 49 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855889.183153:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:1.0:1787855889.183166:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+49:2358:x1874702464263168:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787855889.183186:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855889.183204:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e0e1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d4d expref: 49 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.183240:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e0e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d4d expref: 49 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.183274:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:1.0:1787855889.183281:0:7616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.183293:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.183303:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0fd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.183332:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855889.183414:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+49:2358:x1874702464263168:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 250us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855889.183423:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 67 00010000:00010000:0.0:1787855889.184237:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e0e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d4d expref: 48 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855889.184263:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7489a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486283392:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855889.184296:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.184308:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.184315:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855889.184342:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787855889.184566:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e0f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d5b expref: 49 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.184584:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d5b expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.184606:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:0.0:1787855889.184750:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787855889.184755:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887800, rc 0) 00000100:00100000:0.0:1787855889.185057:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+48:11468:x1874702464263040:12345-192.168.201.38@tcp:101:bash.0 Request processed in 12607us (12932us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787855889.185068:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 160 00000100:00100000:2.0:1787855889.187201:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855889.187282:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464263424 00000100:00100000:3.0:1787855889.187294:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464263424 00000100:00100000:3.0:1787855889.187358:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 161 00000100:00100000:3.0:1787855889.187370:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7489e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+48:11468:x1874702464263424:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:3.0:1787855889.187726:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e10b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855889.187752:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e10b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855889.187767:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e10b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787855889.187938:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1787855889.187963:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002747ffef reply state 0000000055d29a5d transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e10b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855889.187975:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787855889.188083:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7489e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+51:11468:x1874702464263424:12345-192.168.201.38@tcp:36:bash.0 Request processed in 714us (903us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787855889.188092:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 161 00000020:00080000:3.0:1787855889.188118:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787855889.193951:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e10b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.193984:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e10b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.193995:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e10b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.194004:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166c000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855889.194010:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e10b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.194054:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e10b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.194078:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:1.0:1787855889.194082:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855889.194089:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e10b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.194096:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e10b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855889.196868:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855889.198165:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464263552 00000100:00100000:1.0:1787855889.198191:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464263552 00000100:00100000:1.0:1787855889.198290:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 162 00000100:00100000:1.0:1787855889.198303:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+50:11468:x1874702464263552:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:1.0:1787855889.198343:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855889.198378:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e112 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d62 expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.198491:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e119 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.198508:0:9629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0fd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d5b expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.198519:0:9629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e119 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.198564:0:9629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d5b expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.198606:0:9629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d5b expref: 51 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855889.198630:0:9629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74be580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9629:1874702486283520:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855889.198746:0:9629:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c92f5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855889.204475:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855889.204562:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464263680 00000100:00100000:0.0:1787855889.204574:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464263680 00010000:00010000:0.0:1787855889.204639:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0fd lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d5b expref: 52 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855889.204692:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:0.0:1787855889.204704:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7489680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:2357:x1874702464263680:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855889.204725:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855889.204733:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0fd lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d5b expref: 52 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.204749:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d5b expref: 52 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.204803:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:0.0:1787855889.204811:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e119 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.204822:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.204849:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e119 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.204978:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855889.205064:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7489680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:2357:x1874702464263680:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 361us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855889.205073:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 68 00010000:00010000:1.0:1787855889.206602:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e0fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d5b expref: 51 pid: 5833 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855889.206729:0:9629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74be580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9629:1874702486283520:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855889.206766:0:9629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.206793:0:9629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.206799:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855889.206916:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787855889.206922:0:9629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787855889.206951:0:9629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.206995:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e112 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d62 expref: 51 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.207014:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e119 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d62 expref: 50 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.207057:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:1.0:1787855889.207060:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787855889.207065:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe000, rc 0) 00000100:00100000:1.0:1787855889.207313:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+50:11468:x1874702464263552:12345-192.168.201.38@tcp:101:bash.0 Request processed in 9011us (10468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855889.207323:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 162 00000100:00100000:2.0:1787855889.210433:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855889.210539:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464263936 00000100:00100000:1.0:1787855889.210551:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464263936 00000100:00100000:1.0:1787855889.210836:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:1.0:1787855889.210859:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e748a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+50:11468:x1874702464263936:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:1.0:1787855889.211228:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e748a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+51:11468:x1874702464263936:12345-192.168.201.38@tcp:35:bash.0 Request processed in 379us (806us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1787855889.211237:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:2.0:1787855889.314305:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855889.314467:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464264192 00000100:00100000:3.0:1787855889.314479:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464264192 00000100:00100000:3.0:1787855889.314551:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 163 00000100:00100000:3.0:1787855889.314563:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7488b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+51:11478:x1874702464264192:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855889.314594:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855889.314673:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e120 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d69 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855889.314955:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787855889.315116:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e120 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d69 expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855889.315503:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40aca00) 00010000:00010000:3.0:1787855889.315508:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787855889.315516:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e120 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d69 expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855889.315534:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166ce00, rc 0) 00000100:00100000:3.0:1787855889.315835:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7488b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:11478:x1874702464264192:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1272us (1553us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1787855889.315973:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 163 00000100:00100000:2.0:1787855889.321264:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855889.321379:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464264320 00000100:00100000:0.0:1787855889.321393:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464264320 00000100:00100000:0.0:1787855889.321471:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 164 00000100:00100000:0.0:1787855889.321482:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7489a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:11478:x1874702464264320:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:0.0:1787855889.321595:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e12e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.321617:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e12e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.321631:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e12e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.321649:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e135 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.321657:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.321664:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.321953:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e13c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.321981:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e13c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.321989:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e13c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787855889.322057:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e13c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322073:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e12e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322080:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e12e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322087:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e12e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322094:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855889.322098:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e12e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322106:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e12e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322120:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:0.0:1787855889.322123:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855889.322128:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e12e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322135:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e12e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322161:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322168:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e135 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322175:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322180:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855889.322183:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322189:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e135 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322196:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73f49fb300) 00010000:00010000:0.0:1787855889.322199:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855889.322202:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e135 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322209:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e135 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322226:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e13c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322233:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e13c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322239:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e13c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322249:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855889.322253:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e13c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322259:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e13c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322265:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:0.0:1787855889.322267:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855889.322270:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e13c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.322277:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e13c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855889.322370:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7489a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:11478:x1874702464264320:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 888us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855889.322379:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 164 00000100:00100000:0.0:1787855889.326723:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855889.327265:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464264576 00000100:00100000:3.0:1787855889.327278:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464264576 00000100:00100000:3.0:1787855889.327401:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:3.0:1787855889.327414:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:11478:x1874702464264576:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1787855889.327827:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+53:11478:x1874702464264576:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 414us (1118us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787855889.327970:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:2.0:1787855889.368676:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855889.369121:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464264832 00000100:00100000:3.0:1787855889.369135:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464264832 00000100:00100000:2.0:1787855889.369341:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 165 00000100:00100000:2.0:1787855889.369356:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3356580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+53:11481:x1874702464264832:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1787855889.369391:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855889.369424:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e143 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d70 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.369533:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e14a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.369554:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e14a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.369571:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e14a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.369589:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e151 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.369596:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.369604:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370056:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e158 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370067:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370098:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855889.370111:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787855889.370246:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e14a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370255:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e14a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370262:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e14a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370268:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855889.370273:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e14a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370280:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e14a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370296:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:2.0:1787855889.370300:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855889.370305:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e14a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370312:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e14a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370329:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370335:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e151 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370348:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370354:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855889.370357:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370364:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e151 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370372:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73c7093900) 00010000:00010000:2.0:1787855889.370374:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855889.370377:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e151 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370383:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e151 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370439:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e143 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d70 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370454:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d70 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855889.370462:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:2.0:1787855889.370464:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787855889.370467:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7886400, rc 0) 00000100:00100000:2.0:1787855889.370712:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3356580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:11481:x1874702464264832:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1358us (2052us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787855889.370735:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 165 00000100:00100000:2.0:1787855889.374581:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855889.375347:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464264960 00000100:00100000:1.0:1787855889.375364:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464264960 00000100:00100000:1.0:1787855889.375450:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 166 00000100:00100000:1.0:1787855889.375462:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c33552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:11481:x1874702464264960:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:1.0:1787855889.375581:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e166 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.375605:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.376157:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.376223:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.376231:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e166 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.376238:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.376245:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffe00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855889.376250:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.376258:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e166 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.376274:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:1.0:1787855889.376278:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787855889.376284:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e166 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.376291:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e166 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855889.376400:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c33552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:11481:x1874702464264960:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 937us (1836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855889.376410:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 166 00000100:00100000:0.0:1787855889.378338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855889.378420:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464265088 00000100:00100000:1.0:1787855889.378433:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464265088 00000100:00100000:1.0:1787855889.378517:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:1.0:1787855889.378548:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:2359:x1874702464265088:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787855889.378568:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855889.378602:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e158 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d70 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.378623:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:1.0:1787855889.378630:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855889.380374:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:2359:x1874702464265088:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1812us (2034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855889.380391:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:3.0:1787855889.384191:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855889.384430:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464265344 00000100:00100000:1.0:1787855889.384443:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464265344 00000100:00100000:1.0:1787855889.384522:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:1.0:1787855889.384534:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7648f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:11481:x1874702464265344:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1787855889.385030:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7648f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:11481:x1874702464265344:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 495us (852us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787855889.385054:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:3.0:1787855889.532230:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787855889.532270:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa23f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486283648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787855889.532367:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787855889.532504:0:8076:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 380384726931ns, next at 381384723504ns, rc = 0 00000100:00100000:1.0:1787855889.532661:0:12311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486283648 00000100:00100000:1.0:1787855889.532671:0:12311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486283648 00000100:00100000:1.0:1787855889.532744:0:12311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787855889.532757:0:12311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486283648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787855889.532983:0:12311:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787855889.533113:0:12311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486283648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 358us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855889.533122:0:12311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787855889.536130:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa23f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486283648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787855889.541903:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855889.542401:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464265600 00000100:00100000:3.0:1787855889.542415:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464265600 00000100:00100000:3.0:1787855889.542532:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 167 00000100:00100000:3.0:1787855889.542546:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:11499:x1874702464265600:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:3.0:1787855889.542580:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855889.542618:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e16d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d77 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855889.542750:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e174 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855889.542767:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e174 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855889.542821:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e174 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855889.542946:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787855889.543132:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e16d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d77 expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855889.543182:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e174 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d77 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855889.543193:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:3.0:1787855889.543196:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787855889.543201:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166d600, rc 0) 00000100:00100000:3.0:1787855889.543298:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+57:11499:x1874702464265600:12345-192.168.201.38@tcp:101:cat.0 Request processed in 755us (1480us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787855889.543307:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 167 00000100:00100000:0.0:1787855889.572417:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855889.572547:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464265728 00000100:00100000:1.0:1787855889.572578:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464265728 00000100:00100000:1.0:1787855889.572709:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 168 00000100:00100000:1.0:1787855889.572723:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+57:11500:x1874702464265728:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787855889.572755:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855889.572809:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e182 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d7e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.572917:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366e189 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.572935:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366e189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.572950:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366e189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855889.573025:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787855889.573030:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787855889.573086:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366e189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.573120:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e182 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d7e expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.573152:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366e189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d7e expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.573163:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:1.0:1787855889.573166:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787855889.573170:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe400, rc 0) 00000100:00100000:1.0:1787855889.573267:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+58:11500:x1874702464265728:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 546us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855889.573275:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 168 00000100:00100000:0.0:1787855889.584041:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855889.584275:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464266112 00000100:00100000:1.0:1787855889.584295:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464266112 00000100:00100000:1.0:1787855889.585481:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:1.0:1787855889.585497:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+58:11500:x1874702464266112:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:1.0:1787855889.586045:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+59:11500:x1874702464266112:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 540us (2014us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1787855889.586056:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:3.0:1787855889.589979:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855889.590639:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464266240 00000100:00100000:0.0:1787855889.590654:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464266240 00000100:00100000:0.0:1787855889.590974:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:0.0:1787855889.590987:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c554b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+59:11500:x1874702464266240:12345-192.168.201.38@tcp:103:lfs.0 00010000:00010000:0.0:1787855889.591009:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787855889.591071:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e119 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d62 expref: 59 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.591100:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e174 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d77 expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.591116:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e024 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d23 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.591233:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093e00) 00010000:00010000:0.0:1787855889.591248:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855889.591369:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c554b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:11500:x1874702464266240:12345-192.168.201.38@tcp:103:lfs.0 Request processed in 385us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855889.591379:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:3.0:1787855889.598661:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855889.598734:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464266368 00000100:00100000:0.0:1787855889.598745:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464266368 00000100:00100000:0.0:1787855889.598827:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 169 00000100:00100000:0.0:1787855889.598839:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7649e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:11500:x1874702464266368:12345-192.168.201.38@tcp:58:lfs.0 00010000:00010000:0.0:1787855889.598986:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e190 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.599003:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e190 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855889.599013:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e190 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787855889.599459:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787855889.600390:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7649e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:11500:x1874702464266368:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 1545us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855889.600423:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 169 00000100:00100000:3.0:1787855889.625286:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855889.626095:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464266496 00000100:00100000:2.0:1787855889.626109:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464266496 00000100:00100000:1.0:1787855889.626290:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 170 00000100:00100000:1.0:1787855889.626305:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:11502:x1874702464266496:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787855889.626332:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855889.626357:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e197 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d85 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.626465:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e19e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.626484:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e19e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.626497:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e19e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.626515:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e1a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.626523:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.626548:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.626667:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e1ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.626676:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.626683:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855889.626725:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787855889.626730:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787855889.626752:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.626764:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.626773:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e19e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.626828:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e19e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.626835:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e19e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.626842:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855889.627241:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e19e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.627261:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e19e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.627278:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:1.0:1787855889.627281:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855889.627287:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e19e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.627295:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e19e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.627313:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.627319:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e1a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.627326:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e1a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.627331:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855889.627334:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e1a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.627340:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e1a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.627348:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73c8d1d300) 00010000:00010000:1.0:1787855889.627351:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855889.627353:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e1a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.627431:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e1a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.627535:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e197 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d85 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.627551:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e1ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d85 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855889.627558:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb300) 00010000:00010000:1.0:1787855889.627561:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787855889.627563:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ff800, rc 0) 00000100:00100000:1.0:1787855889.627659:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+57:11502:x1874702464266496:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1356us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855889.627668:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 170 00010000:00010000:1.0:1787855890.173507:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787855890.301289:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787855890.301298:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787855890.301332:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787855890.301350:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787855890.301524:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74be580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874702486283776:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787855890.301645:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c92f56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855890.303621:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74be580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874702486283776:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787855890.309679:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855890.313280:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464266624 00000100:00100000:2.0:1787855890.313301:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464266624 00000100:00100000:2.0:1787855890.313400:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 171 00000100:00100000:2.0:1787855890.313412:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+57:11513:x1874702464266624:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1787855890.313749:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:2.0:1787855890.314006:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787855890.314224:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+57:11513:x1874702464266624:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 812us (4559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855890.314235:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 171 00000100:00100000:1.0:1787855890.323384:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855890.323555:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464266752 00000100:00100000:0.0:1787855890.323570:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464266752 00000100:00100000:0.0:1787855890.323714:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 172 00000100:00100000:0.0:1787855890.323728:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+57:11513:x1874702464266752:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787855890.323865:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e1b3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.323887:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e1b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.323901:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e1b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.323922:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e1ba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.323941:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e1ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.323947:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e1ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.323980:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e1c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.323987:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.323994:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855890.324078:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787855890.324083:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787855890.324111:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324234:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e1b3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324242:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e1b3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324250:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e1b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324258:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855890.324262:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e1b3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324271:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e1b3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324286:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a73d40ac700) 00010000:00010000:0.0:1787855890.324289:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855890.324295:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e1b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324303:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e1b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324319:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e1ba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324338:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e1ba lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324344:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e1ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324350:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855890.324354:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e1ba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324360:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e1ba lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324368:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9a73f49fb400) 00010000:00010000:0.0:1787855890.324371:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855890.324374:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e1ba lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324380:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e1ba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324397:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324404:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e1c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324410:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e1c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324416:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855890.324426:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e1c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324433:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e1c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324443:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb300) 00010000:00010000:0.0:1787855890.324446:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855890.324449:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e1c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.324455:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142c00/0x516929ca3366e1c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855890.324565:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+57:11513:x1874702464266752:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 Request processed in 838us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855890.324575:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 172 00000100:00100000:1.0:1787855890.347532:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855890.347601:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464267008 00000100:00100000:1.0:1787855890.347615:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464267008 00000100:00100000:1.0:1787855890.347688:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 173 00000100:00100000:1.0:1787855890.347701:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+57:11513:x1874702464267008:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787855890.347730:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855890.347760:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e1c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d8c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.348082:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.348101:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.348134:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855890.348151:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787855890.348275:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.348284:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.348292:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.348299:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855890.348304:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.348311:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.348331:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb300) 00010000:00010000:1.0:1787855890.348335:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787855890.348341:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.348348:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.348401:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e1c8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d8c expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.348411:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a73d40ac700) 00010000:00010000:1.0:1787855890.348414:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787855890.348418:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e1c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d8c expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.348427:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fec00, rc 0) 00000100:00100000:1.0:1787855890.348519:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+58:11513:x1874702464267008:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 819us (1001us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1787855890.348528:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 173 00000100:00100000:1.0:1787855890.356287:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855890.356397:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464267136 00000100:00100000:3.0:1787855890.356410:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464267136 00000100:00100000:1.0:1787855890.356600:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 174 00000100:00100000:1.0:1787855890.356614:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+58:11513:x1874702464267136:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787855890.356662:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787855890.356833:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+58:11513:x1874702464267136:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 209us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855890.356855:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 174 00000100:00100000:3.0:1787855890.369466:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855890.370566:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464267392 00000100:00100000:3.0:1787855890.370583:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464267392 00000100:00100000:3.0:1787855890.370656:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 175 00000100:00100000:3.0:1787855890.370668:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+58:11513:x1874702464267392:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787855890.370697:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855890.370701:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787855890.370736:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe400/0x516929ca3366e189 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d7e expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.370759:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:3.0:1787855890.370796:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787855890.370817:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e1dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d93 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787855890.373506:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787855890.373799:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e1e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.373822:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.373837:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.375561:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e1dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d93 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.375612:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d93 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.375623:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:3.0:1787855890.375627:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787855890.375630:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166d600, rc 0) 00000100:00100000:3.0:1787855890.376629:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+59:11513:x1874702464267392:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 5954us (7170us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787855890.376643:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 175 00000040:00080000:2.0:1787855890.382081:0:12450:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787855890.382096:0:12450:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787855890.382141:0:12450:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787855890.382149:0:12450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787855890.383428:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855890.383550:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464267648 00000100:00100000:1.0:1787855890.383563:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464267648 00000100:00100000:1.0:1787855890.383625:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 176 00000100:00100000:1.0:1787855890.383636:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa6f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+59:11513:x1874702464267648:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787855890.383712:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855890.383747:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e1e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d93 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.383771:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:1.0:1787855890.383801:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787855890.383829:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.383846:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.383857:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.383873:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366e1f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xec1ab106 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.383881:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366e1f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xec1ab106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.383888:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366e1f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xec1ab106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.385072:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.385087:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.385095:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.385102:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855890.385108:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.385340:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.385361:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:1.0:1787855890.385364:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855890.385370:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.385376:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366e1f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.385389:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366e1f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xec1ab106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.385395:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366e1f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xec1ab106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.385401:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366e1f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xec1ab106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.385413:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855890.385416:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366e1f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xec1ab106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.385423:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366e1f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xec1ab106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.385431:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xec1ab106 (ffff9a73c8d1d300) 00010000:00010000:1.0:1787855890.385433:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855890.385436:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366e1f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xec1ab106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.385441:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366e1f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xec1ab106 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855890.385588:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa6f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+58:11513:x1874702464267648:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 1948us (2164us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787855890.385599:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 176 00000100:00100000:1.0:1787855890.390994:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855890.391076:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464267776 00000100:00100000:2.0:1787855890.391090:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464267776 00000100:00100000:2.0:1787855890.391167:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 177 00000100:00100000:2.0:1787855890.391180:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+58:11513:x1874702464267776:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787855890.391207:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855890.391239:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e200 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616d9a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.391287:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366e207 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.391315:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366e207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.391329:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366e207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.391519:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e200 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d9a expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.391538:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366e207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d9a expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.391546:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:2.0:1787855890.391549:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787855890.391554:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7886200, rc 0) 00000100:00100000:2.0:1787855890.391631:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+59:11513:x1874702464267776:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 454us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855890.391639:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 177 00000100:00100000:1.0:1787855890.404615:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855890.405733:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464268032 00000100:00100000:3.0:1787855890.405748:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464268032 00000100:00100000:3.0:1787855890.405854:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 178 00000100:00100000:3.0:1787855890.405867:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+59:11513:x1874702464268032:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787855890.406028:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e20e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.406052:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e20e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.406067:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e20e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787855890.411396:0:9629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1787855890.411421:0:9629:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381263644453ns, next at 382263640139ns, rc = 0 00000004:00010000:3.0:1787855890.411558:0:9629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005af37b46 reply state 000000008f7b829d transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e20e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855890.411572:0:9629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787855890.411757:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+61:11513:x1874702464268032:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 5885us (7150us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1787855890.411769:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 178 00010000:00010000:2.0:1787855890.419876:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e20e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.419900:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e20e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.419914:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e20e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.419922:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166c000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855890.419928:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e20e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.419953:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e20e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.419984:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:2.0:1787855890.419987:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787855890.419994:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e20e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.420001:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e20e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855890.428720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855890.430187:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464268160 00000100:00100000:3.0:1787855890.430208:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464268160 00000100:00100000:3.0:1787855890.430322:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 179 00000100:00100000:3.0:1787855890.430334:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+60:11513:x1874702464268160:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787855890.430368:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855890.430399:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e215 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616da1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.430482:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e215 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616da1 expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.430529:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e215 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616da1 expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.430556:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:3.0:1787855890.430560:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787855890.430565:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166ce00, rc 0) 00000100:00100000:3.0:1787855890.430670:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+61:11513:x1874702464268160:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 337us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855890.430678:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 179 00000100:00100000:0.0:1787855890.450183:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855890.450252:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464268288 00000100:00100000:2.0:1787855890.450264:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464268288 00000100:00100000:2.0:1787855890.450349:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:2.0:1787855890.450362:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2358:x1874702464268288:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787855890.450523:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787855890.450854:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2358:x1874702464268288:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 493us (681us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787855890.450863:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:1.0:1787855890.459081:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855890.459380:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464268544 00000100:00100000:3.0:1787855890.459395:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464268544 00000100:00100000:3.0:1787855890.459469:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:3.0:1787855890.459492:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+61:11513:x1874702464268544:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787855890.459831:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+62:11513:x1874702464268544:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 352us (764us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787855890.459841:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:2.0:1787855890.471434:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855890.471649:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464268800 00000100:00100000:3.0:1787855890.471662:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464268800 00000100:00100000:3.0:1787855890.471737:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 180 00000100:00100000:3.0:1787855890.471749:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+62:11513:x1874702464268800:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787855890.471925:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+62:11513:x1874702464268800:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 178us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855890.471935:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 180 00000100:00100000:0.0:1787855890.485348:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855890.485477:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464268928 00000100:00100000:3.0:1787855890.485496:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464268928 00000100:00100000:3.0:1787855890.485572:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 181 00000100:00100000:3.0:1787855890.485585:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+62:11513:x1874702464268928:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787855890.485615:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855890.485645:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e21c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616da8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.485739:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e223 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.485757:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e223 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.485771:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e223 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855890.485873:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787855890.485896:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e223 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.485927:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e21c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616da8 expref: 64 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.485946:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e223 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616da8 expref: 63 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.485955:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:3.0:1787855890.485959:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787855890.485963:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166c000, rc 0) 00000100:00100000:3.0:1787855890.486055:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+63:11513:x1874702464268928:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 471us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855890.486070:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 181 00000100:00100000:0.0:1787855890.492635:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855890.493209:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464269056 00000100:00100000:3.0:1787855890.493224:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464269056 00000100:00100000:3.0:1787855890.493306:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:3.0:1787855890.493321:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7489680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2357:x1874702464269056:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787855890.493348:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855890.493379:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000974e779f/0x516929ca3366e22a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616daf expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787855890.493418:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a908412, blocks: 0x1 00010000:00010000:3.0:1787855890.493448:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:3.0:1787855890.493455:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855890.493466:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000974e779f/0x516929ca3366e22a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616daf expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.493488:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000974e779f/0x516929ca3366e22a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616daf expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.493506:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166d000, rc 0) 00000100:00100000:3.0:1787855890.493686:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7489680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2357:x1874702464269056:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 368us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855890.493696:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:3.0:1787855890.505563:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855890.505661:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464269312 00000100:00100000:1.0:1787855890.505672:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464269312 00000100:00100000:1.0:1787855890.505754:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 182 00000100:00100000:1.0:1787855890.505767:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa0a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+63:11513:x1874702464269312:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787855890.506126:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa0a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+63:11513:x1874702464269312:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 349us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855890.506148:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 182 00000100:00100000:3.0:1787855890.511511:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855890.511617:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464269440 00000100:00100000:0.0:1787855890.511630:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464269440 00000100:00100000:0.0:1787855890.511700:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:0.0:1787855890.511714:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:11513:x1874702464269440:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787855890.511748:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855890.511799:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa1ab3eb/0x516929ca3366e231 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616db6 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.512014:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000974e779f/0x516929ca3366e22a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616daf expref: 9 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.512050:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787855890.512056:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787855890.512063:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa1ab3eb/0x516929ca3366e231 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616db6 expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.512294:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000974e779f/0x516929ca3366e22a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616daf expref: 9 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.512315:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000974e779f/0x516929ca3366e22a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616daf expref: 9 pid: 6680 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855890.512334:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa23da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1874702486283904:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787855890.512454:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6180 going to sleep for 11 seconds 00000100:00100000:0.0:1787855890.516434:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa23da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1874702486283904:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855890.516485:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa1ab3eb/0x516929ca3366e231 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616db6 expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.516512:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142e00, rc 0) 00000100:00100000:0.0:1787855890.516599:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:11513:x1874702464269440:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 4886us (5102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855890.516610:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:3.0:1787855890.519426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855890.519500:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464269568 00000100:00100000:0.0:1787855890.519513:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464269568 00010000:00010000:0.0:1787855890.519566:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000974e779f/0x516929ca3366e22a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616daf expref: 9 pid: 6680 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855890.519627:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:0.0:1787855890.519639:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2358:x1874702464269568:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855890.519661:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855890.519690:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000974e779f/0x516929ca3366e22a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616daf expref: 9 pid: 6680 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.519706:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000974e779f/0x516929ca3366e22a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616daf expref: 9 pid: 6680 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.519808:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000974e779f/0x516929ca3366e22a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616daf expref: 9 pid: 6680 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.519827:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787855890.519832:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787855890.519842:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa1ab3eb/0x516929ca3366e231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616db6 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.519855:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa1ab3eb/0x516929ca3366e231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616db6 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.519904:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000aa1ab3eb/0x516929ca3366e231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616db6 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855890.519923:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa23da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1874702486284032:192.168.201.38@tcp:105: 00000100:00100000:0.0:1787855890.520056:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6180 going to sleep for 11 seconds 00000100:00100000:0.0:1787855890.526427:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa23da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1874702486284032:192.168.201.38@tcp:105: 00010000:00010000:0.0:1787855890.526464:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855890.526548:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2358:x1874702464269568:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 6909us (7134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855890.526562:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:0.0:1787855890.527581:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855890.528569:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464269696 00000100:00100000:3.0:1787855890.528586:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464269696 00002000:00100000:3.0:1787855890.528651:0:6685:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9a73fa23da40 x1874702464269696/t0(0) o4->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:46/0 lens 504/0 e 0 to 0 dl 1787855901 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787855890.528661:0:6685:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73fa23da40 with x1874702464269696 ext(0->8) 00002000:00010000:3.0:1787855890.528666:0:6685:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a73fa23da40 00000100:00100000:0.0:1787855890.528755:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:0.0:1787855890.528770:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2357:x1874702464269696:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787855890.529627:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+10:2357:x1874702464269696:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 Request processed in 854us (2042us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787855890.529641:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00002000:00100000:0.0:1787855890.529650:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9a73fa23da40 x1874702464269696/t4294967314(0) o4->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:46/0 lens 504/448 e 0 to 0 dl 1787855901 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787855890.529660:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73fa23da40 with x1874702464269696 ext(0->8) 00002000:00010000:0.0:1787855890.529664:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a73fa23da40 00000100:00100000:3.0:1787855890.533393:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855890.533567:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464269824 00000100:00100000:0.0:1787855890.533580:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464269824 00000100:00100000:0.0:1787855890.533659:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 183 00000100:00100000:0.0:1787855890.533671:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+63:11513:x1874702464269824:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 00000004:00080000:1.0:1787855890.599683:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:1.0:1787855890.599712:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000001:00080000:1.0:1787855890.599733:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:1.0:1787855890.599803:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787855890.599818:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a73d80fa000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787855890.599824:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a73c2e63b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a73d80fab40 00000020:00080000:1.0:1787855890.599827:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a73dfb40400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a73d072f400 00000100:00100000:0.0:1787855890.600210:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+34:11513:x1874702464269824:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 Request processed in 66532us (66826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855890.600227:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 183 00000020:00080000:0.0:1787855890.600270:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787855890.600532:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:1.0:1787855890.601026:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1787855890.601038:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:0.0:1787855890.601262:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d137ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486284160:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787855890.601346:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855890.601537:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486284288:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787855890.601573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855890.601620:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486284160 00000100:00100000:2.0:1787855890.601629:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486284160 00000100:00100000:2.0:1787855890.601678:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486284288 00000100:00100000:2.0:1787855890.601681:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486284288 00000100:00100000:2.0:1787855890.601720:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787855890.601731:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df807840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486284160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787855890.601797:0:6680:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1787855890.601841:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a90840f, atime: 0x6a90840f, ctime: 0x6a90840f, blocks: 0xb 00010000:00010000:2.0:1787855890.601925:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b9f96dd/0x516929ca3366e238 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.601946:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=381s v=(0 0) 00010000:00010000:2.0:1787855890.601952:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855890.601960:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b9f96dd/0x516929ca3366e238 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.601981:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b9f96dd/0x516929ca3366e238 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.601992:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b9f96dd/0x516929ca3366e238 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.602000:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b9f96dd/0x516929ca3366e238 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.602032:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787855890.602902:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787855890.602919:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486284288:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787855890.603082:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787855890.603086:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787855890 00002000:00010000:1.0:1787855890.603089:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787855890.603091:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787855890 -> 1787855890 00002000:00010000:1.0:1787855890.603094:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787855890.603143:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874702486284288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 230us (1568us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787855890.603151:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1787855890.603210:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a73cb6f70c0/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787855890.603217:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486284288:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787855890.603441:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df807840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1874702486284160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1710us (2094us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787855890.603450:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:2.0:1787855890.603477:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855890.603486:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b9f96dd/0x516929ca3366e238 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.603514:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886e00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:2.0:1787855890.603519:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b9f96dd/0x516929ca3366e238 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.603531:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b9f96dd/0x516929ca3366e238 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.603555:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b9f96dd/0x516929ca3366e238 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.603563:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b9f96dd/0x516929ca3366e238 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.603587:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855890.603589:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855890.603590:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855890.607183:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855890.607641:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464269952 00000100:00100000:2.0:1787855890.607653:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464269952 00000100:00100000:2.0:1787855890.607718:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:2.0:1787855890.607732:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1378780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+10:2358:x1874702464269952:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 00000100:00080000:1.0:1787855890.609857:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787855890.611102:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a73d137ad00/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787855890.611118:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d137ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486284160:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1787855890.663446:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:0.0:1787855890.663481:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1787855890.663586:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1378780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2358:x1874702464269952:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 Request processed in 55847us (56411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855890.663601:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:2.0:1787855890.666262:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855890.666526:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464270208 00000100:00100000:3.0:1787855890.666538:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464270208 00000100:00100000:3.0:1787855890.666599:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 184 00000100:00100000:3.0:1787855890.666607:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:11513:x1874702464270208:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787855890.666686:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855890.666726:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e223 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616da8 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.666751:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:3.0:1787855890.666759:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787855890.666833:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e23f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.666862:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e23f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.666876:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e23f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787855890.667314:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4fe01b1 reply state 00000000580c5dbe transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e23f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855890.667329:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787855890.667460:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:11513:x1874702464270208:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 851us (1208us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787855890.667470:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 184 00010000:00010000:1.0:1787855890.669450:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e23f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.669485:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e23f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.669490:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e23f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.669494:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166d000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855890.669499:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e23f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.669505:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e23f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.669521:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:1.0:1787855890.669523:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855890.669528:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e23f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.669531:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e23f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855890.670032:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855890.670107:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464270336 00000100:00100000:3.0:1787855890.670283:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464270336 00000100:00100000:3.0:1787855890.670360:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:3.0:1787855890.670374:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7422580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2358:x1874702464270336:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787855890.670698:0:8077:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787855890.670703:0:8077:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787855890 -> 1787855889 00002000:00010000:3.0:1787855890.670706:0:8077:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787855887 00002000:00010000:3.0:1787855890.670708:0:8077:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787855890 -> 1787855889 00002000:00010000:3.0:1787855890.670711:0:8077:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787855890.670811:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7422580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2358:x1874702464270336:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 439us (799us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787855890.670819:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:0.0:1787855890.674252:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855890.674392:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464270592 00000100:00100000:3.0:1787855890.674407:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464270592 00000100:00100000:3.0:1787855890.674475:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 185 00000100:00100000:3.0:1787855890.674487:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:11513:x1874702464270592:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787855890.674577:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e246 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.674624:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366e207 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d9a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.674634:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e246 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.674991:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366e207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d9a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.675009:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366e207 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d9a expref: 18 pid: 5834 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855890.675041:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874702486284416:192.168.201.38@tcp:104: 00000100:00100000:3.0:1787855890.675194:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c5541180 going to sleep for 11 seconds 00000100:00100000:0.0:1787855890.677597:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855890.677665:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464270720 00000100:00100000:2.0:1787855890.677677:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464270720 00010000:00010000:2.0:1787855890.677733:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366e207 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d9a expref: 19 pid: 5834 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855890.677818:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:2.0:1787855890.677830:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9282d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:2357:x1874702464270720:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855890.677850:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855890.677858:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366e207 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d9a expref: 19 pid: 5834 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.677873:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366e207 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d9a expref: 19 pid: 5834 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.677903:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:2.0:1787855890.677909:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e246 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.677920:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.677929:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e246 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.677953:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855890.678025:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9282d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:2357:x1874702464270720:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 188us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855890.678034:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 70 00010000:00010000:3.0:1787855890.678134:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886200/0x516929ca3366e207 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d9a expref: 18 pid: 5834 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855890.678152:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874702486284416:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787855890.678188:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.678199:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.678204:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.678239:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.678255:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e246 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.678263:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e246 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.678268:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166d600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855890.678272:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e246 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.678278:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e246 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.678284:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:3.0:1787855890.678286:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787855890.678289:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e246 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.678294:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e246 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855890.678343:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+17:11513:x1874702464270592:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 Request processed in 3858us (4105us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787855890.678351:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 185 00000100:00100000:0.0:1787855890.680686:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855890.680736:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464270848 00000100:00100000:2.0:1787855890.680749:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464270848 00000100:00100000:2.0:1787855890.681257:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:2.0:1787855890.681272:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9281a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2358:x1874702464270848:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787855890.681366:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e24d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.681399:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa1ab3eb/0x516929ca3366e231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616db6 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.681409:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855890.681413:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855890.681417:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e24d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.681457:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa1ab3eb/0x516929ca3366e231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616db6 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.681469:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa1ab3eb/0x516929ca3366e231 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616db6 expref: 8 pid: 6679 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855890.681484:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7422940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1874702486284544:192.168.201.38@tcp:104: 00000100:00100000:2.0:1787855890.681579:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e74ac300 going to sleep for 11 seconds 00000100:00100000:2.0:1787855890.683965:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855890.684053:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7422940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1874702486284544:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855890.684093:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e24d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855890.684171:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464270976 00000100:00100000:1.0:1787855890.684179:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464270976 00010000:00010000:1.0:1787855890.684229:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa1ab3eb/0x516929ca3366e231 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616db6 expref: 9 pid: 6679 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855890.684269:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 71 00000100:00100000:1.0:1787855890.684281:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7421a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2358:x1874702464270976:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787855890.684299:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855890.684346:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa1ab3eb/0x516929ca3366e231 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616db6 expref: 9 pid: 6679 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.684360:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa1ab3eb/0x516929ca3366e231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616db6 expref: 9 pid: 6679 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.684390:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa1ab3eb/0x516929ca3366e231 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616db6 expref: 9 pid: 6679 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.684404:0:7616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787855890.684407:0:7616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787855890.684413:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e24d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.684421:0:7616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e24d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.684449:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787855890.684468:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e24d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.684476:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e24d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855890.684514:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7421a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2358:x1874702464270976:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 235us (565us total) trans 0 rc 0/0 00010000:00010000:2.0:1787855890.684516:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e24d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855890.684523:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 71 00010000:00010000:2.0:1787855890.684525:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e24d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.684532:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e24d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.684539:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886a00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:2.0:1787855890.684544:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e24d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.684554:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e24d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.684569:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e24d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.684577:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e24d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855890.684633:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9281a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2358:x1874702464270848:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 Request processed in 3362us (3955us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855890.684640:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:0.0:1787855890.686630:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855890.686763:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464271232 00000100:00100000:3.0:1787855890.686818:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464271232 00000100:00100000:3.0:1787855890.686887:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 186 00000100:00100000:3.0:1787855890.686900:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9283840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+17:11513:x1874702464271232:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787855890.687004:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e254 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.687061:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.687075:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.687365:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e25b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.687379:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e215 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616da1 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.687388:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e25b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.687428:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e215 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616da1 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.687444:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e215 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616da1 expref: 18 pid: 5835 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855890.687462:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486284672:192.168.201.38@tcp:104: 00000100:00100000:3.0:1787855890.687571:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c5541180 going to sleep for 11 seconds 00000100:00100000:3.0:1787855890.691097:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855890.691271:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486284672:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855890.691308:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e25b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855890.691431:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464271360 00000100:00100000:0.0:1787855890.691439:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464271360 00010000:00010000:0.0:1787855890.691485:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e215 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616da1 expref: 19 pid: 5835 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855890.691521:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:0.0:1787855890.691530:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:2358:x1874702464271360:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855890.691548:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855890.691555:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e215 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616da1 expref: 19 pid: 5835 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.691589:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e215 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616da1 expref: 19 pid: 5835 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.691616:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e215 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616da1 expref: 19 pid: 5835 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.691635:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:0.0:1787855890.691640:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e25b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.691651:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e25b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.691659:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e25b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.691688:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855890.691754:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:2358:x1874702464271360:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 224us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855890.691763:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 72 00010000:00010000:1.0:1787855890.691862:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e25b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.691879:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e25b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787855890.692149:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1787855890.692341:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1787855890.692392:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1787855890.692491:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1379a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874702486284800:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787855890.692565:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855890.692609:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c92f5780 going to sleep for 11 seconds 00000100:00100000:2.0:1787855890.694919:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486284800 00000100:00100000:2.0:1787855890.694939:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486284800 00000100:00100000:2.0:1787855890.695031:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787855890.695043:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874702486284800:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787855890.695197:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1874702486284800:12345-0@lo:1000:mdt00_000.0 Request processed in 156us (2631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855890.695205:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787855890.695268:0:5833:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1787855890.695275:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a73cb6f70c0, transno 4294967315 00000100:00100000:1.0:1787855890.695301:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1379a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874702486284800:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787855890.696046:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1787855890.696155:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1379a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874702486284928:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787855890.696699:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855890.696818:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c4529cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855890.697073:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486284928 00000100:00100000:0.0:1787855890.697082:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486284928 00000100:00100000:0.0:1787855890.697299:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787855890.697311:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1874702486284928:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787855890.697580:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1874702486284928:12345-0@lo:1000:mdt00_000.0 Request processed in 272us (881us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787855890.697589:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787855890.697704:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1379a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874702486284928:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787855890.697754:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e25b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.697767:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e25b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.697823:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e25b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.697830:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166d000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855890.697835:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e25b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.697852:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e25b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.697872:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:1.0:1787855890.697875:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787855890.697882:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e25b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.697889:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e25b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.697928:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e190 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.697935:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e190 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.697942:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e190 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.697948:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855890.697951:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e190 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.697957:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e190 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.697966:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb300) 00010000:00010000:1.0:1787855890.697968:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787855890.697971:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e190 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.697987:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e190 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.698031:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e262 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.698048:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e1ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d85 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.698059:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e262 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.698098:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e1ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d85 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.698128:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e1ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d85 expref: 21 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855890.698145:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab83480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486285056:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855890.698654:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c4529cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855890.702737:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab83480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486285056:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855890.702810:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e262 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855890.703733:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855890.703872:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464271488 00000100:00100000:1.0:1787855890.703893:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464271488 00010000:00010000:1.0:1787855890.703958:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e1ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d85 expref: 22 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855890.704024:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:1.0:1787855890.704037:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+22:2357:x1874702464271488:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787855890.704059:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855890.704068:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e1ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d85 expref: 22 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.704083:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e1ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d85 expref: 22 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.704111:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e1ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616d85 expref: 22 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.704138:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb300) 00010000:00010000:1.0:1787855890.704144:0:7616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e262 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.704155:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e262 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.704171:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e262 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855890.704201:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855890.704273:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:2357:x1874702464271488:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 237us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855890.704282:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 73 00010000:00010000:3.0:1787855890.704607:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e262 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.704617:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e262 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.704639:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e262 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.704648:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e262 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.704654:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e262 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.704661:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fec00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855890.704667:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e262 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.704675:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e262 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.704685:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb300) 00010000:00010000:3.0:1787855890.704689:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855890.704693:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e262 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.704699:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366e262 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.704712:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.704718:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e254 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.704725:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e254 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.704736:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166c000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855890.704740:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e254 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.704746:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e254 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.704755:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb300) 00010000:00010000:3.0:1787855890.704758:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787855890.704761:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e254 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855890.704766:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e254 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855890.705094:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9283840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+20:11513:x1874702464271232:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 18194us (18488us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787855890.705105:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 186 00000020:00080000:3.0:1787855890.705109:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787855890.705361:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787855890.705367:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787855890.705891:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787855890.705901:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787855890.709628:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855890.709745:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464271744 00000100:00100000:0.0:1787855890.709760:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464271744 00000100:00100000:0.0:1787855890.709876:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:0.0:1787855890.709889:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73dc262050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+20:11513:x1874702464271744:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787855890.710731:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787855890.710886:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1787855890.710945:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e269 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.710965:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e269 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.710979:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e269 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.710989:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e269 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.710996:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e269 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.711002:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e269 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855890.711046:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787855890.711178:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73dc262050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+22:11513:x1874702464271744:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 1288us (1575us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787855890.711188:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 50 00000020:00080000:0.0:1787855890.711194:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787855890.711760:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855890.711770:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e269 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.711811:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142200 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:2.0:1787855890.711816:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e269 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.711827:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e269 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.711844:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a73f49fbf00) 00010000:00010000:2.0:1787855890.711848:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787855890.711854:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e269 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.711861:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e269 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855890.711887:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855890.711901:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855890.711903:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855891.196834:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855892.224381:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787855892.689029:0:12502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787855892.689047:0:12502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787855892.689102:0:12502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787855892.689109:0:12502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787855892.852301:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855892.852472:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464272000 00000100:00100000:0.0:1787855892.852487:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464272000 00000100:00100000:0.0:1787855892.852618:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 187 00000100:00100000:0.0:1787855892.852632:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+22:11531:x1874702464272000:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1787855892.852667:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1787855892.852698:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787855892.852698:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e270 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616dbd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.853297:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e277 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.853319:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e277 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.853333:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e277 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855892.853347:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787855892.853566:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e270 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dbd expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.853590:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e277 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dbd expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.853600:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:0.0:1787855892.853603:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787855892.853606:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142400, rc 0) 00000100:00100000:0.0:1787855892.853707:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+24:11531:x1874702464272000:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1077us (1418us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1787855892.853716:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 187 00000100:00100000:3.0:1787855892.865510:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855892.865606:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464272128 00000100:00100000:1.0:1787855892.865621:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464272128 00000100:00100000:1.0:1787855892.865697:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 188 00000100:00100000:1.0:1787855892.865710:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+24:11531:x1874702464272128:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:1.0:1787855892.865859:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e285 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.865883:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e285 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.865898:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e285 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.865931:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e28c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.865940:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e28c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.865947:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e28c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866311:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e293 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866321:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866338:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787855892.866385:0:9629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866398:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e285 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866402:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e285 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866408:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e285 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866412:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855892.866415:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e285 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866421:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e285 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866432:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:1.0:1787855892.866434:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855892.866438:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e285 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866442:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffc00/0x516929ca3366e285 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866452:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e28c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866464:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e28c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866470:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e28c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866475:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855892.866478:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e28c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866485:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e28c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866493:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73c8d1d300) 00010000:00010000:1.0:1787855892.866495:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855892.866498:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e28c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866505:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366e28c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866520:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866524:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e293 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866529:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866531:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffe00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855892.866538:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866543:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e293 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866551:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c8d1d400) 00010000:00010000:1.0:1787855892.866554:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855892.866557:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e293 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855892.866563:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e293 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855892.866662:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+24:11531:x1874702464272128:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 952us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855892.866672:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 188 00000100:00100000:3.0:1787855892.926230:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855892.926433:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464272384 00000100:00100000:0.0:1787855892.926463:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464272384 00000100:00100000:0.0:1787855892.926541:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 189 00000100:00100000:0.0:1787855892.926554:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+24:11534:x1874702464272384:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1787855892.926583:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855892.926620:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e29a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616dc4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.926720:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e2a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.926738:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e2a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.926752:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e2a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.926767:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.926802:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.926810:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927224:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927234:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927242:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855892.927261:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787855892.927384:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e2a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927393:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e2a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927400:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e2a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927407:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855892.927413:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e2a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927422:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e2a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927438:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:0.0:1787855892.927442:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855892.927448:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e2a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927455:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e2a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927475:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927481:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927497:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927504:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855892.927507:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927514:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927523:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73f49fb400) 00010000:00010000:0.0:1787855892.927526:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855892.927529:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927535:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927590:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e29a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dc4 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927606:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dc4 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855892.927614:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb200) 00010000:00010000:0.0:1787855892.927616:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787855892.927619:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143a00, rc 0) 00000100:00100000:0.0:1787855892.927712:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+26:11534:x1874702464272384:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1159us (1493us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1787855892.927731:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 189 00000100:00100000:3.0:1787855892.943127:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855892.943189:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464272512 00000100:00100000:3.0:1787855892.943202:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464272512 00000100:00100000:3.0:1787855892.943278:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 190 00000100:00100000:3.0:1787855892.943292:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+26:11534:x1874702464272512:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:3.0:1787855892.943394:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855892.943414:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855892.943427:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855892.943460:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855892.943468:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855892.943475:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855892.943482:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855892.943488:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855892.943497:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855892.943513:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb200) 00010000:00010000:3.0:1787855892.943517:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787855892.943523:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855892.943531:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855892.943625:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+26:11534:x1874702464272512:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 336us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855892.943634:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 190 00000100:00100000:3.0:1787855892.945958:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855892.946072:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464272768 00000100:00100000:2.0:1787855892.946094:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464272768 00000100:00100000:2.0:1787855892.946167:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:2.0:1787855892.946180:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+26:11534:x1874702464272768:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:2.0:1787855892.946481:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+27:11534:x1874702464272768:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 303us (534us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787855892.946491:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:2.0:1787855892.999501:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855893.001470:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464273024 00000100:00100000:0.0:1787855893.001489:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464273024 00000100:00100000:0.0:1787855893.001578:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 191 00000100:00100000:0.0:1787855893.001590:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+27:11059:x1874702464273024:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1787855893.002871:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855893.002908:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e2c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616dcb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.003064:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.003866:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dc4 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.003878:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2cb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.003933:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dc4 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.003953:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dc4 expref: 28 pid: 5834 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855893.003984:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e748a940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874702486285184:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787855893.004310:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cc900 going to sleep for 11 seconds 00000100:00100000:0.0:1787855893.009943:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855893.010001:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464273152 00000100:00100000:0.0:1787855893.010016:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464273152 00010000:00010000:0.0:1787855893.010083:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2af lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dc4 expref: 29 pid: 5834 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855893.010551:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:2.0:1787855893.010567:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+29:2358:x1874702464273152:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855893.010589:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855893.010599:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2af lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dc4 expref: 29 pid: 5834 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.010629:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dc4 expref: 29 pid: 5834 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.010658:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb200) 00010000:00010000:2.0:1787855893.010664:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.010674:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.010683:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2cb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.011456:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dc4 expref: 29 pid: 5834 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855893.011481:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e748a940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874702486285184:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855893.011510:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.011521:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.011527:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855893.011555:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787855893.012012:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855893.012225:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+29:2358:x1874702464273152:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 1658us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855893.012238:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 74 00010000:00010000:0.0:1787855893.015940:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e2c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dcb expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.015999:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dcb expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.016010:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb200) 00010000:00010000:0.0:1787855893.016014:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787855893.016020:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142a00, rc 0) 00000100:00100000:0.0:1787855893.016403:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+28:11059:x1874702464273024:12345-192.168.201.38@tcp:101:bash.0 Request processed in 14810us (16913us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787855893.016438:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 191 00000100:00100000:0.0:1787855893.026908:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.027089:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464273408 00000100:00100000:3.0:1787855893.027103:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464273408 00000100:00100000:3.0:1787855893.027188:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 192 00000100:00100000:3.0:1787855893.027201:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e748a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+28:11059:x1874702464273408:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:3.0:1787855893.027556:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.027580:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.027596:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787855893.027657:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787855893.027683:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b19b417 reply state 00000000b57b298d transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855893.027694:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787855893.027759:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787855893.028302:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e748a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+32:11059:x1874702464273408:12345-192.168.201.38@tcp:36:bash.0 Request processed in 1100us (1405us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787855893.028313:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 192 00000020:00080000:3.0:1787855893.028320:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787855893.031638:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.031677:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.031685:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.031692:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855893.031699:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.031708:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.035081:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb200) 00010000:00010000:3.0:1787855893.035088:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855893.035099:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.035110:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e2d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855893.037221:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855893.037318:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464273536 00000100:00100000:2.0:1787855893.037331:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464273536 00000100:00100000:2.0:1787855893.037415:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 193 00000100:00100000:2.0:1787855893.037428:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+31:11059:x1874702464273536:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1787855893.037464:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855893.037496:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e2e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616dd2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.037585:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e2e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dd2 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.037601:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e2e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dd2 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.037623:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb200) 00010000:00010000:2.0:1787855893.037627:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787855893.037632:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7886c00, rc 0) 00000100:00100000:2.0:1787855893.037708:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+32:11059:x1874702464273536:12345-192.168.201.38@tcp:101:bash.0 Request processed in 282us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855893.037730:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 193 00000100:00100000:0.0:1787855893.041609:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.041698:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464273664 00000100:00100000:3.0:1787855893.041711:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464273664 00000100:00100000:3.0:1787855893.041829:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:3.0:1787855893.041844:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7648f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:11059:x1874702464273664:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1787855893.041872:0:8077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855893.041903:0:8077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039e0bac5/0x516929ca3366e2e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616dd9 expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787855893.041960:0:8077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a908411, atime: 0x6a90840f, ctime: 0x6a908411, blocks: 0xb 00010000:00010000:3.0:1787855893.042004:0:8077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:3.0:1787855893.042010:0:8077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855893.042023:0:8077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039e0bac5/0x516929ca3366e2e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dd9 expref: 8 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.042044:0:8077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000039e0bac5/0x516929ca3366e2e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dd9 expref: 8 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.042061:0:8077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228e00, rc 0) 00000100:00100000:3.0:1787855893.042148:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7648f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:11059:x1874702464273664:12345-192.168.201.38@tcp:101:bash.0 Request processed in 308us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855893.042157:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00080000:0.0:1787855893.042408:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787855893.049380:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.049505:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464273792 00000100:00100000:3.0:1787855893.049516:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464273792 00002000:00010000:3.0:1787855893.049567:0:6686:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787855893.049573:0:6686:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73fab83480 with x1874702464273792 ext(0->18446744073709551615) 00002000:00010000:3.0:1787855893.049601:0:6686:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a73fab83480. 00000100:00100000:3.0:1787855893.049637:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:3.0:1787855893.049649:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2357:x1874702464273792:12345-192.168.201.38@tcp:10:bash.0 00002000:00010000:3.0:1787855893.050047:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787855893.050052:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787855889 -> 1787855893 00002000:00010000:3.0:1787855893.050055:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787855887 -> 1787855887 00002000:00010000:3.0:1787855893.050057:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787855889 -> 1787855893 00002000:00010000:3.0:1787855893.050078:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787855893.050637:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2357:x1874702464273792:12345-192.168.201.38@tcp:10:bash.0 Request processed in 985us (1262us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787855893.050656:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00002000:00010000:3.0:1787855893.050662:0:6686:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787855893.050667:0:6686:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73fab83480 with x1874702464273792 ext(0->18446744073709551615) 00002000:00010000:3.0:1787855893.050675:0:6686:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a73fab83480. 00000100:00100000:3.0:1787855893.143934:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855893.145753:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464273920 00000100:00100000:0.0:1787855893.145771:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464273920 00000100:00100000:0.0:1787855893.145913:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 194 00000100:00100000:0.0:1787855893.145926:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7422940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+32:11547:x1874702464273920:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:0.0:1787855893.146034:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146053:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146065:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146080:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e2f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146086:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146092:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146425:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e2fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146434:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e2fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146450:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e2fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787855893.146496:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e2fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146508:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146514:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146523:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146531:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855893.146535:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146542:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146554:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:0.0:1787855893.146557:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855893.146561:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146567:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e2ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146586:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146598:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e2f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146604:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146609:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855893.146612:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146617:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e2f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146624:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73f49fb400) 00010000:00010000:0.0:1787855893.146626:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855893.146629:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e2f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146634:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e2f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146651:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e2fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146656:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e2fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146661:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e2fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146666:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855893.146674:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e2fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146679:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e2fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146687:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb200) 00010000:00010000:0.0:1787855893.146689:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855893.146692:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e2fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.146698:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e2fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855893.146845:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7422940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+32:11547:x1874702464273920:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 920us (2922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855893.146854:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 194 00000100:00100000:0.0:1787855893.195349:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855893.200305:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464274176 00000100:00100000:2.0:1787855893.200327:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464274176 00000100:00100000:2.0:1787855893.200464:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 195 00000100:00100000:2.0:1787855893.200478:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+32:11551:x1874702464274176:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1787855893.200512:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855893.200545:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e303 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616de0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.202308:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e30a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.202340:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e30a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.202360:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e30a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.202383:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e311 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.202391:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.202398:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.202996:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e318 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.203009:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.203018:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855893.203044:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787855893.205997:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e30a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.206020:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e30a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.206029:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e30a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.206037:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855893.206042:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e30a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.206052:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e30a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.206087:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:2.0:1787855893.206091:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855893.206098:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e30a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.206106:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e30a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.206375:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.206383:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e311 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.206411:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.206417:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855893.206420:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.206426:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e311 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.206435:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73c7093300) 00010000:00010000:2.0:1787855893.206438:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855893.206441:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e311 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.206446:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e311 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.206522:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e303 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616de0 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.206540:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e318 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616de0 expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.206548:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb200) 00010000:00010000:2.0:1787855893.206550:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787855893.206553:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7886400, rc 0) 00000100:00100000:2.0:1787855893.207465:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+34:11551:x1874702464274176:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 6980us (12116us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787855893.207497:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 195 00000100:00100000:2.0:1787855893.211722:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855893.211808:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464274304 00000100:00100000:0.0:1787855893.211823:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464274304 00000100:00100000:0.0:1787855893.211991:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 196 00000100:00100000:0.0:1787855893.212004:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9732940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+34:11551:x1874702464274304:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:0.0:1787855893.212078:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e326 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.212097:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2cb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dcb expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.212108:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e326 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.212179:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dcb expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.212193:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dcb expref: 34 pid: 5834 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855893.212209:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d13792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486285312:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787855893.212316:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cc900 going to sleep for 11 seconds 00000100:00100000:3.0:1787855893.215468:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d13792c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486285312:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787855893.215511:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e326 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855893.220221:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855893.220307:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464274560 00000100:00100000:2.0:1787855893.220323:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464274560 00000100:00100000:2.0:1787855893.220498:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:2.0:1787855893.220516:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+35:5595:x1874702464274560:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787855893.221051:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+36:5595:x1874702464274560:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 537us (836us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1787855893.221065:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:0.0:1787855893.226400:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855893.226826:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464274688 00000100:00100000:1.0:1787855893.226842:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464274688 00010000:00010000:1.0:1787855893.226908:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dcb expref: 36 pid: 5834 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855893.227006:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:1.0:1787855893.227019:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c554a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+36:2357:x1874702464274688:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787855893.227040:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855893.227069:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dcb expref: 36 pid: 5834 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.227086:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dcb expref: 36 pid: 5834 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.227122:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142a00/0x516929ca3366e2cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dcb expref: 36 pid: 5834 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.227148:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb200) 00010000:00010000:1.0:1787855893.227156:0:7616:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e326 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.227168:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.227176:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e326 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.227217:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855893.227307:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c554a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+35:2357:x1874702464274688:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 290us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855893.227316:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 75 00010000:00010000:3.0:1787855893.227432:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.227442:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.227482:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e326 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.227489:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e326 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.227497:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e326 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.227505:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855893.227510:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e326 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.227531:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e326 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.227542:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb200) 00010000:00010000:3.0:1787855893.227545:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787855893.227549:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e326 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.227556:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e326 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855893.227628:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9732940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+34:11551:x1874702464274304:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 15626us (15931us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855893.227638:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 196 00000100:00100000:0.0:1787855893.236238:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.236342:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464274944 00000100:00100000:3.0:1787855893.236357:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464274944 00000100:00100000:3.0:1787855893.236426:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:3.0:1787855893.236439:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+34:11551:x1874702464274944:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1787855893.236952:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+35:11551:x1874702464274944:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 514us (730us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787855893.236963:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 53 00010000:00010000:2.0:1787855893.244116:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855893.350425:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.350535:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464275200 00000100:00100000:3.0:1787855893.350546:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464275200 00000100:00100000:3.0:1787855893.350648:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 197 00000100:00100000:3.0:1787855893.350659:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7446d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+35:11562:x1874702464275200:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:3.0:1787855893.350686:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855893.350709:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e32d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616de7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.350839:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e334 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.350854:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e334 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.350865:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e334 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.350880:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e33b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.350887:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e33b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.350894:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e33b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351241:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e342 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351251:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351258:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855893.351269:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787855893.351372:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e334 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351379:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e334 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351392:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e334 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351398:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855893.351402:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e334 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351410:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e334 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351425:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:3.0:1787855893.351427:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855893.351433:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e334 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351440:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e334 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351453:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e33b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351459:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e33b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351465:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e33b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351471:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855893.351473:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e33b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351488:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e33b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351497:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73d40ac300) 00010000:00010000:3.0:1787855893.351499:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855893.351502:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e33b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351507:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e33b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351549:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e32d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616de7 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351563:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616de7 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.351570:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb200) 00010000:00010000:3.0:1787855893.351572:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787855893.351575:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166c000, rc 0) 00000100:00100000:3.0:1787855893.351638:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7446d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+37:11562:x1874702464275200:12345-192.168.201.38@tcp:101:cat.0 Request processed in 980us (1223us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787855893.351646:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 197 00000100:00100000:0.0:1787855893.356929:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855893.357252:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464275456 00000100:00100000:1.0:1787855893.357262:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464275456 00000100:00100000:1.0:1787855893.357326:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:1.0:1787855893.357336:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb676940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+37:11562:x1874702464275456:12345-192.168.201.38@tcp:35:cat.0 00000100:00100000:1.0:1787855893.358693:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb676940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+38:11562:x1874702464275456:12345-192.168.201.38@tcp:35:cat.0 Request processed in 1351us (1768us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787855893.358723:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 54 00000100:00100000:0.0:1787855893.395375:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.395518:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464275712 00000100:00100000:3.0:1787855893.395528:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464275712 00000100:00100000:3.0:1787855893.395591:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 198 00000100:00100000:3.0:1787855893.395603:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb675680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+38:11563:x1874702464275712:12345-192.168.201.38@tcp:36:rm.0 00010000:00010000:3.0:1787855893.395864:0:9629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787855893.395893:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e342 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616de7 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.395916:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886400/0x516929ca3366e318 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616de0 expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.395928:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e2e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dd2 expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.395937:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73f49fb200) 00010000:00010000:3.0:1787855893.395949:0:9629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787855893.395982:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e350 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.395996:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e350 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.396005:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e350 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.396018:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e357 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.396024:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.396030:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.396816:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e35e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.396828:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e35e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.396836:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e35e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787855893.398366:0:9629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1787855893.398380:0:9629:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384250604353ns, next at 385250600959ns, rc = 0 00010000:00010000:2.0:1787855893.398449:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e365 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398463:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398472:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398480:0:9629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e365 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398494:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e365 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398501:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e365 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398557:0:9629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787855893.398580:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e35e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398587:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e35e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398593:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e35e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398599:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855893.398603:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e35e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398622:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e35e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398635:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093300) 00010000:00010000:2.0:1787855893.398638:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787855893.398643:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e35e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398649:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e35e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398667:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e350 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398680:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e350 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398685:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e350 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398691:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166d000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855893.398694:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e350 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398700:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e350 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398708:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:2.0:1787855893.398710:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855893.398713:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e350 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.398719:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e350 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787855893.398731:0:9629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017ff864c reply state 00000000e7c955ca transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855893.398740:0:9629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787855893.398848:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb675680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+37:11563:x1874702464275712:12345-192.168.201.38@tcp:36:rm.0 Request processed in 3243us (3479us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787855893.398857:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 198 00010000:00010000:3.0:1787855893.406130:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787855893.406146:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e365 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.406159:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887c00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787855893.406163:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e365 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.406174:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e365 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.406195:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a73c7093300) 00010000:00010000:3.0:1787855893.406198:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787855893.406203:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e365 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.406208:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e365 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.406659:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.406670:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e357 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.406676:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e357 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.406682:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166ce00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855893.406686:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e357 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.406692:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e357 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.406702:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73d40ac300) 00010000:00010000:1.0:1787855893.406705:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787855893.406708:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e357 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.406714:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e357 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.407068:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855893.407072:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855893.407073:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855893.462530:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855893.462646:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464275968 00000100:00100000:2.0:1787855893.462657:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464275968 00000100:00100000:2.0:1787855893.462723:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 199 00000100:00100000:2.0:1787855893.462735:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb675e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+36:11569:x1874702464275968:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1787855893.462763:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855893.462815:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e36c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616dee expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.462956:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e373 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.462981:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e373 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.462993:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e373 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.463008:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e37a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.463016:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e37a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.463023:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e37a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787855893.463627:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787855893.463845:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886600/0x516929ca3366e381 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.463857:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886600/0x516929ca3366e381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.463866:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886600/0x516929ca3366e381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.463912:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e373 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.463919:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e373 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.463926:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e373 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.463931:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855893.463936:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e373 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.463943:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e373 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.463956:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:2.0:1787855893.463959:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855893.463964:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e373 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.463983:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e373 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787855893.463997:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2f0c670 reply state 0000000007f2b9c4 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e37a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855893.464005:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787855893.464036:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887600/0x516929ca3366e36c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dee expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.464063:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886600/0x516929ca3366e381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dee expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.464070:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:2.0:1787855893.464072:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787855893.464075:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7886600, rc 0) 00000100:00100000:2.0:1787855893.464157:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb675e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+39:11569:x1874702464275968:12345-192.168.201.38@tcp:101:bash.0 Request processed in 1425us (1638us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787855893.464166:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 199 00010000:00010000:3.0:1787855893.467295:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e37a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.467314:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e37a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.467322:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e37a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.467328:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855893.467332:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e37a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.467357:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e37a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.467373:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73c7093400) 00010000:00010000:3.0:1787855893.467376:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855893.467381:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e37a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.467386:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e37a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855893.473850:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.474418:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464276096 00000100:00100000:3.0:1787855893.474429:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464276096 00000100:00100000:3.0:1787855893.474501:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:3.0:1787855893.474513:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400697840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2360:x1874702464276096:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1787855893.474531:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855893.474555:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e38f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616df5 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787855893.474584:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787855893.474607:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1787855893.474612:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855893.474621:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e38f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616df5 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.474643:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e38f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616df5 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.474678:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166c000, rc 0) 00000100:00100000:3.0:1787855893.474740:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400697840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2360:x1874702464276096:12345-192.168.201.38@tcp:101:bash.0 Request processed in 229us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855893.474749:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00080000:0.0:1787855893.475571:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787855893.479653:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.479733:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464276224 00000100:00100000:3.0:1787855893.479744:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464276224 00000100:00100000:3.0:1787855893.479829:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:3.0:1787855893.479840:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7445e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:11569:x1874702464276224:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1787855893.479859:0:8077:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855893.479877:0:8077:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616dfc expref: -99 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.479915:0:8077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e38f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616df5 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.479925:0:8077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855893.479929:0:8077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855893.479935:0:8077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dfc expref: 7 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.479978:0:8077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e38f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616df5 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.479993:0:8077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e38f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616df5 expref: 7 pid: 6681 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855893.480023:0:8077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7421a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8077:1874702486285440:192.168.201.38@tcp:104: 00000100:00100000:3.0:1787855893.480361:0:8077:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c5541300 going to sleep for 11 seconds 00000100:00100000:1.0:1787855893.484049:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855893.484589:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464276352 00000100:00100000:0.0:1787855893.484599:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464276352 00010000:00010000:0.0:1787855893.484716:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e38f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616df5 expref: 8 pid: 6681 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855893.484768:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:0.0:1787855893.484807:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab81680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2357:x1874702464276352:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855893.484848:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855893.484876:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e38f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616df5 expref: 8 pid: 6681 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.484889:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e38f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616df5 expref: 8 pid: 6681 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.484914:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787855893.484919:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787855893.484928:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dfc expref: 8 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.484938:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dfc expref: 8 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.484993:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dfc expref: 8 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855893.485007:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400695a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1874702486285568:192.168.201.38@tcp:105: 00000100:00100000:0.0:1787855893.485100:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50ccc00 going to sleep for 11 seconds 00010000:00010000:3.0:1787855893.487897:0:8077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e38f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616df5 expref: 8 pid: 6681 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855893.487920:0:8077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7421a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8077:1874702486285440:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787855893.487951:0:8077:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dfc expref: 7 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.487974:0:8077:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166d600, rc 0) 00000100:00100000:1.0:1787855893.488799:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400695a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1874702486285568:192.168.201.38@tcp:105: 00010000:00010000:1.0:1787855893.488817:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855893.488875:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab81680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2357:x1874702464276352:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 4098us (4835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855893.488903:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:2.0:1787855893.490657:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7445e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:11569:x1874702464276224:12345-192.168.201.38@tcp:101:bash.0 Request processed in 10809us (11005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855893.490670:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:0.0:1787855893.494000:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855893.494261:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464276608 00000100:00100000:2.0:1787855893.494272:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464276608 00000100:00100000:2.0:1787855893.494365:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:2.0:1787855893.494376:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400695a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+38:11569:x1874702464276608:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:2.0:1787855893.494734:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400695a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+39:11569:x1874702464276608:12345-192.168.201.38@tcp:35:bash.0 Request processed in 359us (743us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787855893.494742:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 55 00000100:00100000:0.0:1787855893.628204:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7421a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486285696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787855893.628292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855893.628482:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486285696 00000100:00100000:3.0:1787855893.628491:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486285696 00000100:00100000:3.0:1787855893.628571:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787855893.628581:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874702486285696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787855893.628624:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855893.628680:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc254000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874702486285696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855893.628689:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787855893.628740:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7421a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486285696:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787855893.628984:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787855893.644461:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.645085:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464276736 00000100:00100000:3.0:1787855893.645096:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464276736 00000100:00100000:3.0:1787855893.645154:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 200 00000100:00100000:3.0:1787855893.645165:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+39:11585:x1874702464276736:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855893.645204:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855893.645226:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e39d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.645303:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e3a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.645318:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.645329:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855893.645387:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787855893.645392:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787855893.645415:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.645440:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e39d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e03 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.645459:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e03 expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.645468:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:3.0:1787855893.645471:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787855893.645475:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166d000, rc 0) 00000100:00100000:3.0:1787855893.645721:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+40:11585:x1874702464276736:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 556us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855893.645729:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 200 00000100:00100000:1.0:1787855893.651419:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855893.651471:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464276992 00000100:00100000:1.0:1787855893.651481:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464276992 00000100:00100000:1.0:1787855893.651556:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 201 00000100:00100000:1.0:1787855893.651568:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+40:11585:x1874702464276992:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787855893.651590:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855893.651612:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e0a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.651712:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366e3b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.651734:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366e3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.651747:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366e3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855893.651758:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787855893.651913:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e0a expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.651935:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366e3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e0a expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.651945:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:1.0:1787855893.651954:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787855893.651959:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fea00, rc 0) 00000100:00100000:1.0:1787855893.652029:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+42:11585:x1874702464276992:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 463us (623us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787855893.652037:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 201 00000100:00100000:0.0:1787855893.656756:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855893.656811:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855893.656855:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464277376 00000100:00100000:0.0:1787855893.656865:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464277376 00000100:00100000:0.0:1787855893.656937:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:0.0:1787855893.656950:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc2543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+42:2358:x1874702464277376:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855893.656978:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855893.657007:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366e3b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e0a expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.657028:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:0.0:1787855893.657034:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855893.657088:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc2543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+41:2358:x1874702464277376:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 141us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855893.657096:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:0.0:1787855893.657134:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464277248 00000100:00100000:0.0:1787855893.657138:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464277248 00000100:00100000:0.0:1787855893.657177:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 202 00000100:00100000:0.0:1787855893.657185:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc2570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+41:11585:x1874702464277248:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1787855893.657203:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855893.657218:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e3c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e11 expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.657328:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e3c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.657343:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.657353:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e3c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855893.657374:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787855893.658458:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e3c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e11 expref: 44 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.658488:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e3c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e11 expref: 43 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.658497:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:0.0:1787855893.658500:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787855893.658504:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142e00, rc 0) 00000100:00100000:0.0:1787855893.659430:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc2570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+43:11585:x1874702464277248:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 2240us (2678us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787855893.659441:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 202 00000100:00100000:0.0:1787855893.677361:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.678355:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464277504 00000100:00100000:3.0:1787855893.678366:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464277504 00000100:00100000:3.0:1787855893.678427:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:3.0:1787855893.678437:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc254b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+6:2359:x1874702464277504:12345-192.168.201.38@tcp:1:lfs.0 00010000:00010000:3.0:1787855893.678482:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e3d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.678502:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dfc expref: 6 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.678512:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855893.678516:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787855893.678521:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e3d5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.678555:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dfc expref: 6 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.678570:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dfc expref: 6 pid: 8077 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855893.678584:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7421a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1874702486285824:192.168.201.38@tcp:104: 00000100:00100000:3.0:1787855893.678676:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c55416c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855893.682546:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7421a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1874702486285824:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855893.682586:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e3d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855893.687810:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855893.688156:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464277632 00000100:00100000:2.0:1787855893.688165:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464277632 00002000:00100000:2.0:1787855893.688208:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9a73e7421a40 x1874702464277632/t0(0) o4->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:49/0 lens 504/0 e 0 to 0 dl 1787855904 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787855893.688217:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73e7421a40 with x1874702464277632 ext(0->8) 00010000:00010000:2.0:1787855893.688233:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dfc expref: 7 pid: 8077 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.688254:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dfc expref: 7 pid: 8077 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787855893.688261:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a73e7421a40 00000100:00100000:2.0:1787855893.688282:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:2.0:1787855893.688289:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7421a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2357:x1874702464277632:12345-192.168.201.38@tcp:4:lfs.0 00000100:00100000:2.0:1787855893.688728:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7421a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2357:x1874702464277632:12345-192.168.201.38@tcp:4:lfs.0 Request processed in 438us (923us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787855893.688737:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00002000:00100000:2.0:1787855893.688744:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9a73e7421a40 x1874702464277632/t4294967308(0) o4->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:49/0 lens 504/448 e 0 to 0 dl 1787855904 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787855893.688753:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73e7421a40 with x1874702464277632 ext(0->8) 00010000:00010000:2.0:1787855893.688760:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dfc expref: 9 pid: 8077 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.688772:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dfc expref: 9 pid: 8077 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787855893.688802:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a73e7421a40 00000100:00100000:3.0:1787855893.691897:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855893.692277:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464277760 00000100:00100000:2.0:1787855893.692286:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464277760 00010000:00010000:2.0:1787855893.692324:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dfc expref: 9 pid: 8077 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855893.692378:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 77 00000100:00100000:2.0:1787855893.692387:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2360:x1874702464277760:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855893.692403:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787855893.692424:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787855893.692427:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787855893 00002000:00010000:2.0:1787855893.692429:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787855894 00002000:00010000:2.0:1787855893.692431:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787855893 00010000:00010000:2.0:1787855893.692437:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dfc expref: 9 pid: 8077 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.692451:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dfc expref: 9 pid: 8077 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.692472:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045e05704/0x516929ca3366e396 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dfc expref: 9 pid: 8077 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.692489:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855893.692493:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855893.692499:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.692509:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e3d5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.692547:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855893.692600:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2360:x1874702464277760:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 214us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855893.692607:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 77 00010000:00010000:3.0:1787855893.692748:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.692768:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.692823:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e3d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.692831:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e3d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.692838:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e3d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.692845:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166c000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787855893.692849:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e3d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.692858:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e3d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.692869:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e3d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.692877:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002de3b783/0x516929ca3366e3d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855893.692931:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc254b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2359:x1874702464277504:12345-192.168.201.38@tcp:1:lfs.0 Request processed in 14495us (15581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855893.692939:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:3.0:1787855893.695681:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855893.695740:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464278016 00000100:00100000:1.0:1787855893.695748:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464278016 00000100:00100000:1.0:1787855893.695807:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 56 00000100:00100000:1.0:1787855893.695813:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73dc261450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+43:11585:x1874702464278016:12345-192.168.201.38@tcp:35:lfs.0 00000004:00010000:1.0:1787855893.695863:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e3c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e11 expref: 43 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787855893.696308:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1787855893.696346:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1787855893.696606:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1787855893.696647:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.696660:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886600/0x516929ca3366e381 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dee expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.696666:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3dc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.696694:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886600/0x516929ca3366e381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dee expref: 47 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855893.696705:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886600/0x516929ca3366e381 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dee expref: 47 pid: 5835 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855893.696732:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9282d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874702486285952:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855893.697027:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c4529600 going to sleep for 11 seconds 00000100:00100000:1.0:1787855893.699810:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855893.699869:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464278144 00000100:00100000:2.0:1787855893.699877:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464278144 00010000:00010000:2.0:1787855893.699910:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886600/0x516929ca3366e381 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dee expref: 48 pid: 5835 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855893.699948:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:2.0:1787855893.699957:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+48:2358:x1874702464278144:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855893.699981:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855893.699988:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886600/0x516929ca3366e381 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dee expref: 48 pid: 5835 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.700002:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886600/0x516929ca3366e381 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dee expref: 48 pid: 5835 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.700024:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:2.0:1787855893.700029:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.700039:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.700046:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3dc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855893.700074:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855893.700122:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+48:2358:x1874702464278144:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 167us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855893.700136:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 78 00010000:00010000:0.0:1787855893.700363:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886600/0x516929ca3366e381 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dee expref: 47 pid: 5835 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855893.700375:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9282d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874702486285952:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787855893.700393:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.700407:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.700411:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787855893.700526:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787855893.700680:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1787855893.700759:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73c9282d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874702486286080:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787855893.700834:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855893.700854:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c1d3e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787855893.700948:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486286080 00000100:00100000:1.0:1787855893.700952:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486286080 00000100:00100000:1.0:1787855893.701016:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787855893.701024:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5837:x1874702486286080:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787855893.701101:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5837:x1874702486286080:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 78us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855893.701108:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787855893.701323:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787855893.701352:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73c9282d00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874702486286080:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787855893.701656:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787855893.701696:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1322940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874702486286208:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787855893.701719:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855893.701738:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c1d3ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787855893.701925:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486286208 00000100:00100000:1.0:1787855893.701930:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486286208 00000100:00100000:1.0:1787855893.701973:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787855893.701981:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9282d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5837:x1874702486286208:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787855893.702136:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9282d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5837:x1874702486286208:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 156us (415us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787855893.702143:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787855893.702457:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1322940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874702486286208:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787855893.702496:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1787855893.702527:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.702534:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3dc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.702539:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.702552:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffe00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855893.702556:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.702562:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3dc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.702573:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:0.0:1787855893.702575:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787855893.702578:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3dc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855893.702582:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e3dc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787855893.702903:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787855893.703008:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1787855893.703019:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 384555242668ns, next at 385555240766ns, rc = 0 00000001:00080000:0.0:1787855893.703025:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1787855893.703109:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73c7093f00) 00010000:00010000:0.0:1787855893.703111:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787855893.703116:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366e3c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e11 expref: 51 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855893.703231:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73dc261450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+50:11585:x1874702464278016:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 7418us (7557us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1787855893.703236:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 56 00000020:00080000:0.0:1787855893.703240:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000001:00080000:1.0:1787855893.704509:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:1.0:1787855893.708828:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.708917:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464278272 00000100:00100000:3.0:1787855893.708940:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464278272 00000100:00100000:3.0:1787855893.709008:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 203 00000100:00100000:3.0:1787855893.709018:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+50:11585:x1874702464278272:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855893.709041:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855893.709075:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e3e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e18 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.709139:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e3e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e18 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.709155:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e3e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e18 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.709177:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:3.0:1787855893.709180:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787855893.709184:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166c000, rc 0) 00000100:00100000:3.0:1787855893.709236:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+51:11585:x1874702464278272:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 219us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855893.709244:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 203 00000100:00100000:2.0:1787855893.723896:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.724088:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464278528 00000100:00100000:3.0:1787855893.724231:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464278528 00000100:00100000:3.0:1787855893.724302:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:3.0:1787855893.724312:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+51:11585:x1874702464278528:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1787855893.724565:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:11585:x1874702464278528:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 254us (680us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1787855893.724571:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 57 00000100:00100000:2.0:1787855893.824138:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.824233:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464278656 00000100:00100000:3.0:1787855893.824253:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464278656 00000100:00100000:3.0:1787855893.824315:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 204 00000100:00100000:3.0:1787855893.824326:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:11595:x1874702464278656:12345-192.168.201.38@tcp:34:lfs.0 00010000:00010000:3.0:1787855893.824404:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e3ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824421:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e3ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824433:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e3ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824449:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e3f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824457:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824464:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824566:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e3f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824593:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824601:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787855893.824644:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824657:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e3ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824664:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e3ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824670:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e3ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824676:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166ce00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855893.824680:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e3ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824688:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e3ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824699:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:3.0:1787855893.824702:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855893.824706:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e3ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824713:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e3ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824733:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824738:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e3f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824743:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824748:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166d600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855893.824751:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824757:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e3f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824765:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73d40acb00) 00010000:00010000:3.0:1787855893.824767:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855893.824770:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e3f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824815:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e3f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824830:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824837:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e3f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824843:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824866:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855893.824869:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824875:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e3f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824883:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:3.0:1787855893.824886:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855893.824889:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e3f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.824894:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e3f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855893.824974:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:11595:x1874702464278656:12345-192.168.201.38@tcp:34:lfs.0 Request processed in 648us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855893.824983:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 204 00000100:00100000:1.0:1787855893.868997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.869330:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464278912 00000100:00100000:3.0:1787855893.869340:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464278912 00000100:00100000:3.0:1787855893.869421:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 205 00000100:00100000:3.0:1787855893.869432:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+52:11598:x1874702464278912:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855893.869454:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855893.869475:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e3ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e1f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.869545:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e406 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.869577:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.869588:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.869603:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e40d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.869923:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e40d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.869931:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e40d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870082:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e414 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870091:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870098:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855893.870214:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787855893.870327:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870336:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e406 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870342:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e406 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870354:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855893.870359:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e406 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870367:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e406 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870381:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:3.0:1787855893.870384:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855893.870389:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e406 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870395:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e406 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870408:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e40d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870414:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e40d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870421:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e40d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870426:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855893.870429:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e40d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870435:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e40d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870452:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73d40acb00) 00010000:00010000:3.0:1787855893.870454:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855893.870458:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e40d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870464:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e40d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870503:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e3ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e1f expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870517:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e1f expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.870524:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:3.0:1787855893.870526:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787855893.870528:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166d600, rc 0) 00000100:00100000:3.0:1787855893.870599:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:11598:x1874702464278912:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1168us (1637us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787855893.870670:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 205 00000100:00100000:2.0:1787855893.875596:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.876968:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464279040 00000100:00100000:3.0:1787855893.876983:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464279040 00000100:00100000:3.0:1787855893.877053:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 206 00000100:00100000:3.0:1787855893.877065:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:11598:x1874702464279040:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:3.0:1787855893.877134:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e422 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.877160:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.877184:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.877215:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.877223:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e422 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.877231:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e422 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.877237:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166ce00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855893.877249:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e422 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.877257:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e422 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.877270:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:3.0:1787855893.877273:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787855893.877278:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e422 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855893.877284:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e422 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855893.877368:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:11598:x1874702464279040:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 305us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855893.877376:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 206 00000100:00100000:2.0:1787855893.883744:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.883842:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464279296 00000100:00100000:3.0:1787855893.883868:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464279296 00000100:00100000:3.0:1787855893.883908:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:3.0:1787855893.883915:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+54:11598:x1874702464279296:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1787855893.884181:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:11598:x1874702464279296:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 265us (446us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787855893.884187:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 58 00000100:00100000:1.0:1787855893.931503:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855893.931551:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855893.931691:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464279552 00000100:00100000:3.0:1787855893.931700:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464279552 00000100:00100000:3.0:1787855893.931801:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 162 00000100:00100000:3.0:1787855893.931814:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2359:x1874702464279552:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855893.931891:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464279424 00000100:00100000:2.0:1787855893.931897:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464279424 00000100:00100000:3.0:1787855893.931900:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2359:x1874702464279552:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 81us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855893.931911:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 162 00000100:00100000:2.0:1787855893.931931:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 297 00000100:00100000:2.0:1787855893.931940:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2359:x1874702464279424:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855893.931980:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2359:x1874702464279424:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 42us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855893.931987:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 297 00000100:00080000:0.0:1787855893.932655:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855894.029329:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855894.029447:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464279808 00000100:00100000:3.0:1787855894.029458:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464279808 00000100:00100000:3.0:1787855894.029588:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 207 00000100:00100000:3.0:1787855894.029599:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:11609:x1874702464279808:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1787855894.029623:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855894.029626:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787855894.029655:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e3a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e03 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.029674:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:3.0:1787855894.029679:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787855894.029694:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e429 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e26 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.029868:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e430 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.029883:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.029895:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855894.029905:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787855894.030042:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e429 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e26 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.030058:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e26 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.030066:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:3.0:1787855894.030069:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787855894.030072:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229000, rc 0) 00000100:00100000:3.0:1787855894.030132:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:11609:x1874702464279808:12345-192.168.201.38@tcp:101:bash.0 Request processed in 535us (814us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787855894.030140:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 207 00000100:00080000:0.0:1787855894.034878:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855894.036084:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855894.036143:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855894.036236:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464279936 00000100:00100000:2.0:1787855894.036246:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464279936 00000100:00100000:2.0:1787855894.036314:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:2.0:1787855894.036326:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa096d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:2360:x1874702464279936:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855894.036341:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855894.036367:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e430 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e26 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.036388:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:2.0:1787855894.036394:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855894.036449:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa096d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:2360:x1874702464279936:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 126us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855894.036472:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:3.0:1787855894.036737:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464280192 00000100:00100000:3.0:1787855894.036741:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464280192 00000100:00100000:3.0:1787855894.036809:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 208 00000100:00100000:3.0:1787855894.036818:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa094f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+55:11609:x1874702464280192:12345-192.168.201.38@tcp:36:bash.0 00010000:00010000:3.0:1787855894.036870:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855894.036890:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e414 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e1f expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.036904:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:3.0:1787855894.036908:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787855894.037113:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e43e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.037128:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e43e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.037139:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e43e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787855894.037191:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1787855894.037213:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a656af55 reply state 00000000fd88fb50 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e43e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855894.037222:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787855894.037447:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa094f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+57:11609:x1874702464280192:12345-192.168.201.38@tcp:36:bash.0 Request processed in 629us (1369us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1787855894.037455:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 208 00000020:00080000:3.0:1787855894.037460:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787855894.045709:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e43e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.045726:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e43e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.045734:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e43e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.045741:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855894.045746:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e43e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.045754:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e43e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.045772:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:2.0:1787855894.045817:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855894.045823:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e43e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.045830:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e43e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855894.046684:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855894.047046:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464280320 00000100:00100000:3.0:1787855894.047067:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464280320 00000100:00100000:3.0:1787855894.047121:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 209 00000100:00100000:3.0:1787855894.047132:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f763e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+56:11609:x1874702464280320:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:3.0:1787855894.047154:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855894.047173:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e445 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e2d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.047287:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e44c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.047303:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e44c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.047315:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e44c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855894.047347:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787855894.047352:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787855894.047373:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e44c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.047402:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e445 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e2d expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.047419:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e44c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e2d expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.047428:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:3.0:1787855894.047431:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787855894.047435:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229000, rc 0) 00000100:00100000:3.0:1787855894.047573:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f763e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+57:11609:x1874702464280320:12345-192.168.201.38@tcp:101:bash.0 Request processed in 443us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855894.047581:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 209 00000100:00100000:1.0:1787855894.056039:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855894.056219:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464280576 00000100:00100000:3.0:1787855894.056229:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464280576 00000100:00100000:3.0:1787855894.056294:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:3.0:1787855894.056304:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa096580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+57:11609:x1874702464280576:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:3.0:1787855894.056667:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa096580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+58:11609:x1874702464280576:12345-192.168.201.38@tcp:35:bash.0 Request processed in 363us (636us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1787855894.056674:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 59 00000100:00100000:3.0:1787855894.140077:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa9dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486286592:0@lo:400:kworker.0 00000100:00100000:3.0:1787855894.140167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855894.140241:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787855894.140247:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa9dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486286720:0@lo:400:kworker.0 00000100:00100000:3.0:1787855894.140268:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855894.140301:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486286592 00000100:00100000:3.0:1787855894.140308:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486286592 00000100:00100000:3.0:1787855894.140353:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486286720 00000100:00100000:3.0:1787855894.140355:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486286720 00000100:00100000:3.0:1787855894.140375:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787855894.140383:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486286592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855894.140429:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486286592:12345-0@lo:400:kworker.0 Request processed in 47us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855894.140436:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787855894.140450:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787855894.140456:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486286720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855894.140484:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486286720:12345-0@lo:400:kworker.0 Request processed in 28us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855894.140489:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787855894.140520:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa9dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486286720:0@lo:400:kworker.0 00000100:00100000:3.0:1787855894.140529:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa9dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486286592:0@lo:400:kworker.0 00000100:00100000:0.0:1787855894.140814:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa9dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486286464:0@lo:400:kworker.0 00000100:00100000:0.0:1787855894.140847:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855894.140865:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787855894.140871:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa9dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486286336:0@lo:400:kworker.0 00000100:00100000:0.0:1787855894.140897:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855894.140942:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486286336 00000100:00100000:0.0:1787855894.140946:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486286336 00000100:00100000:0.0:1787855894.140987:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787855894.140993:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486286336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855894.141028:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486286336:12345-0@lo:400:kworker.0 Request processed in 35us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855894.141035:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:0.0:1787855894.141063:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855894.141079:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa9dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486286336:0@lo:400:kworker.0 00000100:00100000:2.0:1787855894.141262:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486286464 00000100:00100000:2.0:1787855894.141267:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486286464 00000100:00100000:2.0:1787855894.141296:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787855894.141303:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486286464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855894.141341:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486286464:12345-0@lo:400:kworker.0 Request processed in 39us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855894.141356:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787855894.141629:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa9dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486286464:0@lo:400:kworker.0 00000100:00100000:1.0:1787855894.186629:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855894.191988:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464280704 00000100:00100000:3.0:1787855894.192004:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464280704 00000100:00100000:3.0:1787855894.192200:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 210 00000100:00100000:3.0:1787855894.192212:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa096940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+58:11615:x1874702464280704:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855894.192237:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855894.192262:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e453 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e34 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.192333:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e45a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.192346:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e45a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.192358:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e45a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855894.192419:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787855894.192423:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787855894.192442:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e45a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.192467:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e453 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e34 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.192484:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e45a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e34 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.192492:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:3.0:1787855894.192520:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787855894.192524:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228600, rc 0) 00000100:00100000:3.0:1787855894.192593:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa096940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+59:11615:x1874702464280704:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 384us (5972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855894.192600:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 210 00000100:00100000:2.0:1787855894.207021:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855894.210241:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464280832 00000100:00100000:3.0:1787855894.210258:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464280832 00000100:00100000:3.0:1787855894.210332:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 211 00000100:00100000:3.0:1787855894.210344:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+59:11615:x1874702464280832:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855894.210364:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855894.210386:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e461 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e3b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.210461:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e468 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.210476:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e468 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.210487:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e468 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215018:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e46f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215046:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e46f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215059:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e46f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215178:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e476 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215188:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215195:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855894.215239:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787855894.215243:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787855894.215264:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215276:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215285:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e468 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215291:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e468 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215315:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e468 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215320:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166d600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855894.215324:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e468 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215332:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e468 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215345:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:2.0:1787855894.215348:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855894.215353:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e468 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215359:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e468 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215374:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e46f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215380:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e46f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215385:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e46f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215389:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855894.215392:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e46f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215407:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e46f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215415:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73d40acb00) 00010000:00010000:2.0:1787855894.215418:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855894.215421:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e46f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215428:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e46f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215467:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229600/0x516929ca3366e461 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e3b expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215481:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e3b expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.215489:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:2.0:1787855894.215491:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787855894.215493:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887a00, rc 0) 00000100:00100000:2.0:1787855894.215574:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+60:11615:x1874702464280832:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 5231us (8563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855894.215584:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 211 00000100:00100000:1.0:1787855894.229496:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855894.229589:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464281088 00000100:00100000:2.0:1787855894.229599:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464281088 00000100:00100000:2.0:1787855894.229663:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 212 00000100:00100000:2.0:1787855894.229673:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+60:11615:x1874702464281088:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1787855894.229703:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855894.229728:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e47d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e42 expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.229869:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.229885:0:9629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e44c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e2d expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.229892:0:9629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e476 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e3b expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.229900:0:9629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.229944:0:9629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e3b expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.229967:0:9629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e3b expref: 61 pid: 5834 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855894.229982:0:9629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa9c1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9629:1874702486286848:192.168.201.38@tcp:104: 00010000:00010000:2.0:1787855894.230086:0:9629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e44c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e2d expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.230096:0:9629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e44c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e2d expref: 61 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855894.230118:0:9629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa9c0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9629:1874702486286976:192.168.201.38@tcp:104: 00000100:00100000:2.0:1787855894.230143:0:9629:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d07d5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855894.230866:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855894.231040:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464281216 00000100:00100000:2.0:1787855894.231045:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464281216 00010000:00010000:2.0:1787855894.231074:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e476 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e3b expref: 62 pid: 5834 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855894.231111:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:2.0:1787855894.231120:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df848b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+62:2358:x1874702464281216:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855894.231131:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855894.231137:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e476 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e3b expref: 62 pid: 5834 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.231150:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e3b expref: 62 pid: 5834 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.231171:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:2.0:1787855894.231176:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.231184:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.231190:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855894.231321:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df848b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+62:2358:x1874702464281216:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 201us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855894.231341:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:1.0:1787855894.243332:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00010000:2.0:1787855894.243557:0:9629:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.38@tcp) returned -22 from blocking AST (req@00000000bf321afd x1874702486286848) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e476 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e3b expref: 61 pid: 5834 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.243582:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887a00/0x516929ca3366e476 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e3b expref: 61 pid: 5834 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855894.243601:0:9629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa9c1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9629:1874702486286848:192.168.201.38@tcp:104: 00000100:00100000:2.0:1787855894.243612:0:9629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa9c0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9629:1874702486286976:192.168.201.38@tcp:104: 00010000:00010000:2.0:1787855894.243635:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:2.0:1787855894.243641:0:9629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.243651:0:9629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.243659:0:9629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855894.246477:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464281344 00000100:00100000:0.0:1787855894.246494:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464281344 00010000:00010000:0.0:1787855894.246542:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e44c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e2d expref: 61 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855894.246592:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:0.0:1787855894.246603:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c5548050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+61:2360:x1874702464281344:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855894.246618:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855894.246640:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e44c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e2d expref: 61 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.246653:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e44c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e2d expref: 61 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.246674:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229000/0x516929ca3366e44c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e2d expref: 61 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.246691:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:0.0:1787855894.246696:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.246705:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.246714:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.246833:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855894.246909:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c5548050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+60:2360:x1874702464281344:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 308us (3586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855894.246918:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 80 00010000:00010000:2.0:1787855894.254553:0:9629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.254574:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787855894.254608:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787855894.254814:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886a00/0x516929ca3366e47d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e42 expref: 61 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.255036:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e42 expref: 60 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.255045:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:2.0:1787855894.255049:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787855894.255052:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887200, rc 0) 00000100:00100000:2.0:1787855894.255182:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+60:11615:x1874702464281088:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 25509us (25693us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787855894.255192:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 212 00010000:00010000:2.0:1787855894.269078:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855894.270183:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855894.270358:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464281600 00000100:00100000:1.0:1787855894.270368:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464281600 00000100:00100000:1.0:1787855894.270436:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:1.0:1787855894.270446:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9dde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+60:11615:x1874702464281600:12345-192.168.201.38@tcp:103:lfs.0 00010000:00010000:1.0:1787855894.270463:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855894.270487:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e3e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e18 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.270506:0:7616:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:1.0:1787855894.270511:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855894.270565:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9dde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+59:11615:x1874702464281600:12345-192.168.201.38@tcp:103:lfs.0 Request processed in 120us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855894.270574:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:2.0:1787855894.276288:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855894.276353:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464281728 00000100:00100000:1.0:1787855894.276362:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464281728 00000100:00100000:1.0:1787855894.276414:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 213 00000100:00100000:1.0:1787855894.276423:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+59:11615:x1874702464281728:12345-192.168.201.38@tcp:58:lfs.0 00010000:00010000:1.0:1787855894.276539:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e492 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.276557:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e492 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.276569:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e492 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787855894.276743:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787855894.276860:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+59:11615:x1874702464281728:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 437us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855894.276869:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 213 00000100:00100000:3.0:1787855894.279885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855894.280036:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464281856 00000100:00100000:0.0:1787855894.280045:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464281856 00000100:00100000:0.0:1787855894.280119:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 214 00000100:00100000:0.0:1787855894.280129:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+59:11615:x1874702464281856:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:0.0:1787855894.280149:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855894.280170:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e499 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e49 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.280241:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e492 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.280252:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e499 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e49 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.280269:0:5833:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e492 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.280281:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e499 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e49 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.280295:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:0.0:1787855894.280298:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787855894.280302:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e499 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e49 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.280309:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143400, rc 0) 00000100:00100000:0.0:1787855894.280371:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+60:11615:x1874702464281856:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 243us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855894.280378:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 214 00000100:00100000:2.0:1787855894.652508:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fab81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486287104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787855894.652588:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855894.652993:0:12311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486287104 00000100:00100000:0.0:1787855894.653002:0:12311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486287104 00000100:00100000:0.0:1787855894.653056:0:12311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787855894.653067:0:12311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874702486287104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787855894.653105:0:12311:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855894.653161:0:12311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874702486287104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855894.653183:0:12311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787855894.653331:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1787855894.653337:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a73d137ad00, transno 4294967307 00000100:00100000:2.0:1787855894.653358:0:3306:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9a73d1322940 x1874702486286208/t4294967309(4294967309) o1000->lustre-OST0001-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1787855909 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt_rdpg00_001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855894.653377:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fab81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486287104:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787855894.780079:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787855894.780100:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787855894.780142:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787855894.780148:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787855894.780272:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa9c2940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874702486287232:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787855894.780515:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d07d5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787855894.785979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855894.786309:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464281984 00000100:00100000:1.0:1787855894.786319:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464281984 00000100:00100000:1.0:1787855894.786384:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 215 00000100:00100000:1.0:1787855894.786394:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+61:11617:x1874702464281984:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787855894.786424:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787855894.786533:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+61:11617:x1874702464281984:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 141us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855894.786542:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 215 00000100:00100000:2.0:1787855894.787384:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa9c2940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874702486287232:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787855894.792231:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855894.792883:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464282112 00000100:00100000:0.0:1787855894.792893:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464282112 00000100:00100000:0.0:1787855894.792958:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 216 00000100:00100000:0.0:1787855894.792968:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+60:11617:x1874702464282112:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787855894.793037:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e4a0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793063:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793074:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793089:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4a7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793097:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793103:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793123:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793131:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793137:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787855894.793190:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787855894.793194:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787855894.793206:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793217:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793223:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e4a0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793230:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e4a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793236:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855894.793240:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e4a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793247:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e4a0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793258:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a73d40ac700) 00010000:00010000:0.0:1787855894.793261:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855894.793266:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e4a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793271:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366e4a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793286:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793300:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4a7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793306:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793311:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855894.793314:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793320:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4a7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793326:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9a73f49fb400) 00010000:00010000:0.0:1787855894.793328:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855894.793331:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4a7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793336:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4a7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793350:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793356:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793361:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793366:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855894.793373:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793379:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793385:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:0.0:1787855894.793387:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855894.793390:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.793395:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855894.793464:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+60:11617:x1874702464282112:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 Request processed in 497us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855894.793472:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 216 00000100:00100000:0.0:1787855894.802929:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855894.803182:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464282368 00000100:00100000:1.0:1787855894.803192:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464282368 00000100:00100000:1.0:1787855894.803252:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 217 00000100:00100000:1.0:1787855894.803262:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+60:11617:x1874702464282368:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787855894.803283:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855894.803304:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366e4b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e50 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.803404:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e4bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.803421:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.803432:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855894.803462:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787855894.803570:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.803578:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e4bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.803585:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e4bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.803591:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffe00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787855894.803596:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e4bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.803604:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e4bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.803617:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:1.0:1787855894.803620:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787855894.803624:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e4bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.803631:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffe00/0x516929ca3366e4bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.803672:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366e4b5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e50 expref: 62 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.803684:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a73d40ac700) 00010000:00010000:1.0:1787855894.803686:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787855894.803695:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366e4b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e50 expref: 62 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.803705:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe200, rc 0) 00000100:00100000:1.0:1787855894.803815:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+61:11617:x1874702464282368:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 553us (896us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1787855894.803824:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 217 00000100:00100000:3.0:1787855894.811489:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855894.811671:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464282496 00000100:00100000:0.0:1787855894.811682:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464282496 00000100:00100000:0.0:1787855894.811745:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 218 00000100:00100000:0.0:1787855894.811755:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+61:11617:x1874702464282496:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787855894.811845:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787855894.811956:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+61:11617:x1874702464282496:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 202us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855894.811964:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 218 00000100:00100000:2.0:1787855894.822652:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855894.822819:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464282752 00000100:00100000:3.0:1787855894.822831:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464282752 00000100:00100000:3.0:1787855894.822910:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 219 00000100:00100000:3.0:1787855894.822920:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+61:11617:x1874702464282752:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787855894.822951:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855894.822954:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787855894.822991:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228600/0x516929ca3366e45a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e34 expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.823009:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:3.0:1787855894.823013:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787855894.823034:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e4ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e57 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787855894.823519:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1787855894.823729:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e4d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.823743:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.823752:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.823842:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e4ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e57 expref: 63 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.823857:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e57 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.823863:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a73d40ac900) 00010000:00010000:3.0:1787855894.823875:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787855894.823878:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166d000, rc 0) 00000100:00100000:3.0:1787855894.823960:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+62:11617:x1874702464282752:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1040us (1318us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787855894.823969:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 219 00000100:00100000:1.0:1787855894.836049:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855894.836230:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464283008 00000100:00100000:0.0:1787855894.836241:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464283008 00000100:00100000:0.0:1787855894.836302:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 220 00000100:00100000:0.0:1787855894.836311:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+62:11617:x1874702464283008:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787855894.836383:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855894.836409:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e4d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e57 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836430:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a73d40ac900) 00010000:00010000:0.0:1787855894.836442:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787855894.836464:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4df lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836478:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836488:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836503:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x9cd1ffa7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836510:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9cd1ffa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836516:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9cd1ffa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836589:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836596:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836602:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836613:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855894.836617:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836623:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836631:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:0.0:1787855894.836634:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855894.836637:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4df lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836643:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e4df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836654:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9cd1ffa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836660:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9cd1ffa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836665:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9cd1ffa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836670:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855894.836672:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9cd1ffa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836677:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9cd1ffa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836692:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x9cd1ffa7 (ffff9a73f49fb400) 00010000:00010000:0.0:1787855894.836694:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855894.836697:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9cd1ffa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855894.836702:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143800/0x516929ca3366e4e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9cd1ffa7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855894.837209:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+61:11617:x1874702464283008:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 524us (797us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787855894.837217:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 220 00000100:00100000:2.0:1787855894.841121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855894.841322:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464283136 00000100:00100000:3.0:1787855894.841332:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464283136 00000100:00100000:3.0:1787855894.841384:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 221 00000100:00100000:3.0:1787855894.841393:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+61:11617:x1874702464283136:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787855894.841413:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855894.841435:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e4ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e5e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.841471:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e4f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.841485:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.841496:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.841591:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e4ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e5e expref: 63 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.841609:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e5e expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.841617:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:3.0:1787855894.841625:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787855894.841628:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166c000, rc 0) 00000100:00100000:3.0:1787855894.841689:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+62:11617:x1874702464283136:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 297us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855894.841696:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 221 00000100:00100000:3.0:1787855894.859491:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855894.859656:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464283392 00000100:00100000:2.0:1787855894.859666:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464283392 00000100:00100000:2.0:1787855894.859729:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 222 00000100:00100000:2.0:1787855894.859740:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+62:11617:x1874702464283392:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787855894.860185:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e4fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.860202:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e4fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.860213:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e4fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787855894.860473:0:9629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1787855894.860483:0:9629:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385712706960ns, next at 386712704568ns, rc = 0 00000004:00010000:2.0:1787855894.860579:0:9629:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d6f02a8 reply state 00000000db98b089 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e4fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855894.860588:0:9629:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787855894.860688:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+64:11617:x1874702464283392:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 948us (1204us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787855894.860697:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 222 00000100:00100000:0.0:1787855894.874236:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00010000:3.0:1787855894.874911:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e4fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.874923:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e4fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.874930:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e4fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.874935:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855894.874950:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e4fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.874959:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e4fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.874977:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:3.0:1787855894.874980:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787855894.874986:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e4fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.874993:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886800/0x516929ca3366e4fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855894.875964:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464283520 00000100:00100000:2.0:1787855894.875977:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464283520 00000100:00100000:2.0:1787855894.876034:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 223 00000100:00100000:2.0:1787855894.876044:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+63:11617:x1874702464283520:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787855894.876084:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855894.876104:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e502 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e65 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.876167:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e65 expref: 64 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.876181:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e65 expref: 64 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.876199:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:2.0:1787855894.876202:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787855894.876206:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887e00, rc 0) 00000100:00100000:2.0:1787855894.876271:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+64:11617:x1874702464283520:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 228us (2044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855894.876278:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 223 00000100:00100000:3.0:1787855894.887105:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855894.887970:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464283648 00000100:00100000:2.0:1787855894.887981:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464283648 00000100:00100000:2.0:1787855894.888059:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:2.0:1787855894.888068:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2357:x1874702464283648:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787855894.888365:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+10:2357:x1874702464283648:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 296us (1279us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787855894.888373:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:3.0:1787855894.899613:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855894.899804:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464283904 00000100:00100000:0.0:1787855894.899814:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464283904 00000100:00100000:0.0:1787855894.899876:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:0.0:1787855894.899886:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+64:11617:x1874702464283904:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787855894.900155:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+65:11617:x1874702464283904:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 269us (551us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787855894.900164:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 60 00000100:00100000:0.0:1787855894.906838:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855894.907004:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464284160 00000100:00100000:3.0:1787855894.907014:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464284160 00000100:00100000:3.0:1787855894.907077:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 224 00000100:00100000:3.0:1787855894.907088:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc2543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+65:11617:x1874702464284160:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787855894.907211:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc2543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+65:11617:x1874702464284160:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 124us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855894.907219:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 224 00000100:00100000:2.0:1787855894.914692:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855894.914767:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464284288 00000100:00100000:3.0:1787855894.914808:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464284288 00000100:00100000:3.0:1787855894.914865:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 225 00000100:00100000:3.0:1787855894.914874:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+65:11617:x1874702464284288:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787855894.914894:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855894.914912:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e509 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e6c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.915015:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e510 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.915028:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.915221:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855894.915258:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787855894.915275:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.915316:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e509 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e6c expref: 67 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.915334:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e510 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e6c expref: 66 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855894.915343:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:3.0:1787855894.915345:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787855894.915349:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166d600, rc 0) 00000100:00100000:3.0:1787855894.915395:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+66:11617:x1874702464284288:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 523us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855894.915402:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 225 00000100:00100000:0.0:1787855894.931452:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855894.932430:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464284416 00000100:00100000:2.0:1787855894.932440:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464284416 00000100:00100000:2.0:1787855894.932530:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:2.0:1787855894.932541:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+10:2358:x1874702464284416:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787855894.932558:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855894.932580:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e517 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e73 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787855894.932607:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a908417, blocks: 0x1 00010000:00010000:2.0:1787855894.932626:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1787855894.932631:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855894.932640:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e73 expref: 11 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.932658:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e73 expref: 11 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.932671:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887000, rc 0) 00000100:00100000:2.0:1787855894.932743:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+11:2358:x1874702464284416:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 204us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855894.932751:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:0.0:1787855894.941079:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855894.941170:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464284672 00000100:00100000:3.0:1787855894.941181:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464284672 00000100:00100000:3.0:1787855894.941245:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 226 00000100:00100000:3.0:1787855894.941255:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa096d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+66:11617:x1874702464284672:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787855894.941356:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa096d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+66:11617:x1874702464284672:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 102us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855894.941364:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 226 00000100:00100000:0.0:1787855894.958559:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855894.958678:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464284800 00000100:00100000:2.0:1787855894.958689:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464284800 00000100:00100000:2.0:1787855894.958752:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:2.0:1787855894.958763:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+11:11617:x1874702464284800:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787855894.958818:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855894.958841:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a06e47d/0x516929ca3366e51e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e7a expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.958894:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e517 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e73 expref: 12 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.958903:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855894.958908:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855894.958914:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a06e47d/0x516929ca3366e51e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e7a expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.958959:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e73 expref: 12 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.958974:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e517 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e73 expref: 12 pid: 6679 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855894.958999:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa9c3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1874702486287360:192.168.201.38@tcp:104: 00000100:00100000:2.0:1787855894.959110:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d07d5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787855894.973463:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855894.973700:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa9c3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1874702486287360:192.168.201.38@tcp:104: 00010000:00010000:2.0:1787855894.973734:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a06e47d/0x516929ca3366e51e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e7a expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855894.973757:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887c00, rc 0) 00000100:00100000:2.0:1787855894.973855:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+12:11617:x1874702464284800:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 15093us (15307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855894.973864:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:1.0:1787855894.973960:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464284928 00000100:00100000:1.0:1787855894.973968:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464284928 00010000:00010000:1.0:1787855894.974004:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e517 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e73 expref: 12 pid: 6679 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855894.974046:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:1.0:1787855894.974056:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb676940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+12:2358:x1874702464284928:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787855894.974069:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855894.974095:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e517 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e73 expref: 12 pid: 6679 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.974110:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e517 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e73 expref: 12 pid: 6679 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.974134:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e517 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e73 expref: 12 pid: 6679 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.974151:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787855894.974163:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787855894.974173:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a06e47d/0x516929ca3366e51e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e7a expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.974186:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a06e47d/0x516929ca3366e51e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e7a expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855894.974224:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001a06e47d/0x516929ca3366e51e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e7a expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855894.974239:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1874702486287488:192.168.201.38@tcp:105: 00000100:00100000:1.0:1787855894.974292:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c4529000 going to sleep for 11 seconds 00000100:00100000:0.0:1787855894.996978:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855894.997054:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1874702486287488:192.168.201.38@tcp:105: 00000100:00100000:3.0:1787855894.997074:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464285056 00010000:00010000:1.0:1787855894.997078:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855894.997081:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464285056 00002000:00100000:3.0:1787855894.997131:0:6685:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9a7400695a40 x1874702464285056/t0(0) o4->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:50/0 lens 504/0 e 0 to 0 dl 1787855905 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787855894.997147:0:6685:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a7400695a40 with x1874702464285056 ext(0->12) 00002000:00010000:3.0:1787855894.997152:0:6685:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a7400695a40 00000100:00100000:1.0:1787855894.997179:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb676940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+12:2358:x1874702464284928:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 23125us (23727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855894.997190:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:3.0:1787855894.997195:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:3.0:1787855894.997202:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400695a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+11:2357:x1874702464285056:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787855894.997608:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400695a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:2357:x1874702464285056:12345-192.168.201.38@tcp:4:lhsmtool_posix.0 Request processed in 404us (638us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787855894.997615:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00002000:00100000:3.0:1787855894.997621:0:6685:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9a7400695a40 x1874702464285056/t4294967320(0) o4->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:50/0 lens 504/448 e 0 to 0 dl 1787855905 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787855894.997631:0:6685:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a7400695a40 with x1874702464285056 ext(0->12) 00002000:00010000:3.0:1787855894.997634:0:6685:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a7400695a40 00000100:00100000:0.0:1787855895.013835:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855895.013933:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464285184 00000100:00100000:3.0:1787855895.013953:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464285184 00000100:00100000:3.0:1787855895.014012:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 227 00000100:00100000:3.0:1787855895.014022:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+66:11617:x1874702464285184:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787855895.098024:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+66:11617:x1874702464285184:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 Request processed in 83991us (84188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855895.098039:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 227 00000001:00080000:1.0:1787855895.098168:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1787855895.098183:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1787855895.098199:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a72c1d3ec00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787855895.098203:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a73fa6cb100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a72c1d3e900 00000020:00080000:1.0:1787855895.098207:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a73fa6cbc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a73f9db9400 00000020:00080000:1.0:1787855895.098246:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1787855895.098276:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a73c92f5540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787855895.098279:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a73c93c8b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a73c330e600 00000020:00080000:1.0:1787855895.098300:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a73c93c8900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a72c136dc00 00000004:00080000:1.0:1787855895.098317:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1787855895.098344:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1787855895.099239:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787855895.099473:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787855895.099641:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787855895.099658:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73ffd2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486287616:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787855895.099724:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855895.099882:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486287616 00000100:00100000:0.0:1787855895.099890:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486287616 00000100:00100000:0.0:1787855895.099958:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787855895.099968:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874702486287616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787855895.099994:0:6679:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1787855895.100029:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a908415, atime: 0x6a908416, ctime: 0x6a908415, blocks: 0x1 00010000:00010000:0.0:1787855895.100048:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366e525 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.100065:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=385s v=(0 0) 00010000:00010000:0.0:1787855895.100070:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787855895.100076:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366e525 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.100092:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366e525 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.100102:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366e525 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.100110:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366e525 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.100126:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787855895.100589:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1874702486287616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 620us (862us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787855895.100598:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:0.0:1787855895.100634:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855895.100641:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366e525 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.100650:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142200 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855895.100654:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366e525 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.100664:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366e525 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.100679:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366e525 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.100688:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366e525 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.100706:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855895.100708:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855895.100709:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787855895.100738:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a73ffd2e1c0/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787855895.100745:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73ffd2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486287616:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1787855895.100892:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787855895.107562:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73ffd2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486287744:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787855895.107637:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855895.107694:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787855895.107701:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73ffd2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486287872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787855895.107727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855895.107811:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486287744 00000100:00100000:1.0:1787855895.107819:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486287744 00000100:00100000:1.0:1787855895.107874:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486287872 00000100:00100000:1.0:1787855895.107877:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486287872 00000100:00100000:1.0:1787855895.107897:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787855895.107907:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1874702486287744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787855895.107949:0:6680:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1787855895.107975:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e52c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855895.107998:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000039e0bac5/0x516929ca3366e2e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dd9 expref: 12 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855895.108007:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787855895.108012:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787855895.108016:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e52c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855895.108058:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000039e0bac5/0x516929ca3366e2e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dd9 expref: 12 pid: 8077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855895.108073:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000039e0bac5/0x516929ca3366e2e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dd9 expref: 12 pid: 8077 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855895.108107:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1874702486288000:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787855895.108164:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c4529f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787855895.108310:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787855895.108321:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1874702486287872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787855895.108489:0:8077:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787855895.108493:0:8077:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787855895 00002000:00010000:0.0:1787855895.108495:0:8077:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787855895.108503:0:8077:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787855895 -> 1787855895 00002000:00010000:0.0:1787855895.108506:0:8077:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787855895.108563:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3304:x1874702486287872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 244us (833us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787855895.108570:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1787855895.108675:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787855895.108743:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a73ffd2c780/2, rc 0, transno 4294967321 00000100:00100000:1.0:1787855895.108750:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73ffd2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486287872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787855895.122871:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855895.122948:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855895.123080:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1874702486288000:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787855895.123112:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e52c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855895.123248:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464285440 00000100:00100000:3.0:1787855895.123256:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464285440 00000100:00100000:3.0:1787855895.123336:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:3.0:1787855895.123347:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:2358:x1874702464285440:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787855895.125975:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464285312 00000100:00100000:2.0:1787855895.125990:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464285312 00010000:00010000:2.0:1787855895.126044:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000039e0bac5/0x516929ca3366e2e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dd9 expref: 14 pid: 8077 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855895.126090:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:2.0:1787855895.126099:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+14:2358:x1874702464285312:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855895.126113:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855895.126119:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000039e0bac5/0x516929ca3366e2e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dd9 expref: 14 pid: 8077 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.126134:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000039e0bac5/0x516929ca3366e2e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dd9 expref: 14 pid: 8077 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.126164:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039e0bac5/0x516929ca3366e2e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dd9 expref: 14 pid: 8077 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.126189:0:7616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855895.126194:0:7616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855895.126200:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e52c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.126220:0:7616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e52c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.126249:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855895.126308:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+13:2358:x1874702464285312:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 210us (3446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855895.126316:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 82 00010000:00010000:2.0:1787855895.126341:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e52c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.126350:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e52c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.126359:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e52c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.126367:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e52c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.126384:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787855895.126973:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3304:x1874702486287744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19065us (19333us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787855895.126981:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1787855895.127007:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855895.127013:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e52c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.127028:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffe00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:2.0:1787855895.127032:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e52c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.127041:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e52c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.127054:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e52c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.127062:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e52c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.127079:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855895.127081:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855895.127082:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787855895.127601:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787855895.128907:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a73ffd2f480/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787855895.128922:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73ffd2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486287744:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1787855895.189759:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:1.0:1787855895.189817:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:1.0:1787855895.189824:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:3.0:1787855895.190012:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2358:x1874702464285440:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 Request processed in 66662us (67066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855895.190024:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:0.0:1787855895.200557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855895.200681:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464285696 00000100:00100000:3.0:1787855895.200692:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464285696 00000100:00100000:3.0:1787855895.200756:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 228 00000100:00100000:3.0:1787855895.200767:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+20:11617:x1874702464285696:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787855895.200846:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855895.200874:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e510 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e6c expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.200895:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:3.0:1787855895.200900:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787855895.200932:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e533 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.200956:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.200967:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787855895.201384:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abf2b0b2 reply state 00000000850246b8 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855895.201395:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787855895.201496:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:11617:x1874702464285696:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 729us (946us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787855895.201520:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 228 00000100:00100000:0.0:1787855895.205335:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855895.205747:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464285824 00000100:00100000:1.0:1787855895.205757:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464285824 00000100:00100000:1.0:1787855895.205846:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:1.0:1787855895.205856:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2360:x1874702464285824:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787855895.206069:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787855895.206073:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787855895 -> 1787855894 00002000:00010000:1.0:1787855895.206076:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787855894 00002000:00010000:1.0:1787855895.206078:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787855895 -> 1787855894 00002000:00010000:1.0:1787855895.206091:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787855895.206155:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2360:x1874702464285824:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 300us (830us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787855895.206175:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 69 00010000:00010000:2.0:1787855895.206554:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.206565:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e533 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.206572:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e533 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.206578:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166ce00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855895.206582:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e533 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.206596:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e533 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.206611:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:2.0:1787855895.206614:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855895.206619:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e533 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.206625:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e533 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855895.214634:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855895.214722:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464286080 00000100:00100000:2.0:1787855895.214731:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464286080 00000100:00100000:2.0:1787855895.214819:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 229 00000100:00100000:2.0:1787855895.214830:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+20:11617:x1874702464286080:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787855895.214901:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e53a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.214918:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e4f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e5e expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.214927:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e53a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.214969:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e5e expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.214983:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e4f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e5e expref: 20 pid: 5834 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855895.215021:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa9c3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874702486288128:192.168.201.38@tcp:104: 00000100:00100000:2.0:1787855895.215274:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d08aa540 going to sleep for 11 seconds 00000100:00100000:2.0:1787855895.217554:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa9c3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874702486288128:192.168.201.38@tcp:104: 00010000:00010000:2.0:1787855895.217585:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e53a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855895.220060:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855895.220631:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464286208 00000100:00100000:2.0:1787855895.220641:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464286208 00010000:00010000:2.0:1787855895.220679:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e4f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e5e expref: 21 pid: 5834 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855895.220724:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 83 00000100:00100000:2.0:1787855895.220734:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:2358:x1874702464286208:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855895.220750:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855895.220757:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e4f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e5e expref: 21 pid: 5834 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.220770:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e5e expref: 21 pid: 5834 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.220809:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e4f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e5e expref: 21 pid: 5834 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.220827:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:2.0:1787855895.220832:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e53a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.220853:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e53a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.220860:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e53a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.220891:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855895.220949:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+20:2358:x1874702464286208:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 215us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855895.220957:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 83 00010000:00010000:3.0:1787855895.221020:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e53a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.221027:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e53a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.221066:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e53a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.221073:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e53a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.221080:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e53a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.221095:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855895.221099:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e53a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.221106:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e53a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.221114:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:3.0:1787855895.221117:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787855895.221120:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e53a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.221126:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887800/0x516929ca3366e53a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855895.221178:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:11617:x1874702464286080:12345-192.168.201.38@tcp:55:lhsmtool_posix.0 Request processed in 6349us (6553us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787855895.221185:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 229 00000100:00100000:3.0:1787855895.223963:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855895.224049:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464286336 00000100:00100000:2.0:1787855895.224058:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464286336 00000100:00100000:2.0:1787855895.224118:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:2.0:1787855895.224128:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2359:x1874702464286336:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787855895.224173:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e541 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.224193:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a06e47d/0x516929ca3366e51e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e7a expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.224202:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787855895.224206:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855895.224211:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e541 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.224243:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a06e47d/0x516929ca3366e51e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e7a expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.224272:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a06e47d/0x516929ca3366e51e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e7a expref: 8 pid: 6680 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855895.224286:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa9c3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1874702486288256:192.168.201.38@tcp:104: 00000100:00100000:2.0:1787855895.224353:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d08aa540 going to sleep for 11 seconds 00000100:00100000:2.0:1787855895.233823:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa9c3840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1874702486288256:192.168.201.38@tcp:104: 00010000:00010000:2.0:1787855895.233857:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e541 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855895.238762:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855895.238933:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464286464 00000100:00100000:2.0:1787855895.238951:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464286464 00010000:00010000:2.0:1787855895.238995:0:7616:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a06e47d/0x516929ca3366e51e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e7a expref: 9 pid: 6680 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855895.239047:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:2.0:1787855895.239058:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+9:2360:x1874702464286464:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855895.239074:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855895.239105:0:7616:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a06e47d/0x516929ca3366e51e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e7a expref: 9 pid: 6680 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.239120:0:7616:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a06e47d/0x516929ca3366e51e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e7a expref: 9 pid: 6680 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.239146:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a06e47d/0x516929ca3366e51e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e7a expref: 9 pid: 6680 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.239179:0:7616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855895.239183:0:7616:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787855895.239189:0:7616:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e541 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.239199:0:7616:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e541 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.239236:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855895.239383:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2360:x1874702464286464:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 326us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855895.239392:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 84 00010000:00010000:3.0:1787855895.239979:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e541 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.239991:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e541 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.240018:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e541 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.240025:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e541 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.240043:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e541 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.240051:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886400 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787855895.240056:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e541 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.240065:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e541 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.240101:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e541 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.240110:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e541 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855895.240167:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2359:x1874702464286336:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 Request processed in 16040us (16214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855895.240175:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 70 00000100:00100000:0.0:1787855895.248018:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855895.248219:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464286720 00000100:00100000:3.0:1787855895.248229:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464286720 00000100:00100000:3.0:1787855895.248285:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 230 00000100:00100000:3.0:1787855895.248294:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:11617:x1874702464286720:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787855895.248366:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e548 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.248385:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.248397:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.248612:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e54f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.248624:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e502 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e65 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.248653:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e54f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.248685:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e65 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.248698:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e502 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e65 expref: 20 pid: 5834 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855895.248714:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa9de580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486288384:192.168.201.38@tcp:104: 00000100:00100000:3.0:1787855895.248820:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c55410c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855895.251999:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855895.252132:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa9de580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486288384:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787855895.252159:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e54f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855895.256641:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464286848 00000100:00100000:2.0:1787855895.256656:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464286848 00010000:00010000:2.0:1787855895.256706:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e502 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e65 expref: 21 pid: 5834 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855895.256755:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:2.0:1787855895.256765:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:2358:x1874702464286848:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855895.256797:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855895.256805:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e502 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e65 expref: 21 pid: 5834 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.256819:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e65 expref: 21 pid: 5834 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.256864:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e502 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e65 expref: 21 pid: 5834 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.256882:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:2.0:1787855895.256888:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e54f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.256898:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e54f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.256906:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e54f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.257279:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855895.257338:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+20:2358:x1874702464286848:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 573us (5349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855895.257347:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 85 00010000:00010000:3.0:1787855895.258902:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e54f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.258917:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e54f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787855895.259306:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1787855895.259453:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787855895.259496:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787855895.259578:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa9c3840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874702486288512:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787855895.259642:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855895.259743:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d08aac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787855895.263419:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486288512 00000100:00100000:1.0:1787855895.263438:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486288512 00000100:00100000:1.0:1787855895.263519:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787855895.263531:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1874702486288512:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787855895.263664:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1874702486288512:12345-0@lo:1000:mdt00_000.0 Request processed in 136us (4021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855895.263672:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787855895.263834:0:5833:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1787855895.263841:0:5833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1787855895.263862:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a73ffd2c780, transno 4294967321 00000100:00100000:0.0:1787855895.263882:0:5833:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9a73ffd2f480 x1874702486287744/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787855911 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855895.263895:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa9c3840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874702486288512:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787855895.264877:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787855895.264962:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73ffd2ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874702486288640:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787855895.265013:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855895.265194:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486288640 00000100:00100000:1.0:1787855895.265201:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486288640 00000100:00100000:1.0:1787855895.265243:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787855895.265251:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1874702486288640:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787855895.265410:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5833:x1874702486288640:12345-0@lo:1000:mdt00_000.0 Request processed in 159us (396us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787855895.265417:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787855895.265499:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2da3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787855895.265529:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73ffd2ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874702486288640:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787855895.265565:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e54f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.265587:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e54f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.265595:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e54f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.265602:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166d600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855895.265607:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e54f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.265615:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e54f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.265631:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a73d40ac600) 00010000:00010000:0.0:1787855895.265634:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787855895.265638:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e54f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.265645:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e54f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.265677:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e492 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.265683:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e492 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.265689:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e492 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.265695:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855895.265703:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e492 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.265709:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e492 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.265718:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:0.0:1787855895.265720:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787855895.265726:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e499 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e49 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.265737:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e499 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e49 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.265746:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e499 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e49 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.265772:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e499 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e49 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855895.266099:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73ffd2f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486288768:192.168.201.38@tcp:105: 00000100:00100000:0.0:1787855895.266178:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2da3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787855895.269966:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855895.270095:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73ffd2f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874702486288768:192.168.201.38@tcp:105: 00010000:00010000:0.0:1787855895.270127:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e492 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270138:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e492 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270188:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e556 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270202:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e556 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270215:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e556 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270224:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e556 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270231:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e556 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270237:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e556 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270243:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855895.270247:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e556 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270254:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e556 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270265:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:0.0:1787855895.270269:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787855895.270272:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e556 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270278:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366e556 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270301:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270307:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e548 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270313:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e548 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270318:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166d000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787855895.270322:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e548 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270328:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e548 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270336:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:0.0:1787855895.270338:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787855895.270341:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e548 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855895.270347:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e548 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855895.270595:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+23:11617:x1874702464286720:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 22300us (22586us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1787855895.270605:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 230 00000020:00080000:0.0:1787855895.270611:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787855895.271016:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787855895.271022:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787855895.271534:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787855895.271544:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787855895.275307:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855895.282654:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464286976 00000100:00100000:2.0:1787855895.282671:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464286976 00000100:00100000:2.0:1787855895.282737:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464287232 00000100:00100000:2.0:1787855895.282740:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464287232 00000100:00100000:2.0:1787855895.282762:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:2.0:1787855895.282772:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df8492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+24:11615:x1874702464286976:12345-192.168.201.38@tcp:49:lfs.0 00000100:00100000:2.0:1787855895.282957:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df8492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+24:11615:x1874702464286976:12345-192.168.201.38@tcp:49:lfs.0 Request processed in 185us (13000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855895.282965:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 61 00000100:00100000:2.0:1787855895.282983:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 62 00000100:00100000:2.0:1787855895.282991:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73dc260850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+23:11617:x1874702464287232:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787855895.289238:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787855895.289444:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1787855895.289521:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e55d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855895.289538:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e55d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855895.289550:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e55d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855895.289559:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e55d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855895.289572:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e55d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855895.289578:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e55d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855895.289603:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787855895.289719:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73dc260850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+25:11617:x1874702464287232:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 6724us (14416us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1787855895.289730:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 62 00000020:00080000:1.0:1787855895.289737:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787855895.291589:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855895.291602:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e55d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.291612:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ffa00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:2.0:1787855895.291616:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e55d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.291625:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e55d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.291642:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a73c8d1d300) 00010000:00010000:2.0:1787855895.291645:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787855895.291649:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e55d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.291655:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ffa00/0x516929ca3366e55d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.291676:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855895.291678:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855895.291680:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855895.292502:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855895.296657:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855895.297461:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464287488 00000100:00100000:0.0:1787855895.297474:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464287488 00000100:00100000:0.0:1787855895.297542:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 231 00000100:00100000:0.0:1787855895.297552:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+25:11615:x1874702464287488:12345-192.168.201.38@tcp:58:lfs.0 00000040:00080000:0.0:1787855895.298169:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1787855895.298273:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+25:11615:x1874702464287488:12345-192.168.201.38@tcp:58:lfs.0 Request processed in 720us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855895.298281:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 231 00000100:00100000:3.0:1787855895.356194:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855895.356345:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464287616 00000100:00100000:2.0:1787855895.356368:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464287616 00000100:00100000:2.0:1787855895.356430:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 232 00000100:00100000:2.0:1787855895.356440:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+25:11619:x1874702464287616:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:2.0:1787855895.356475:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855895.356497:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e564 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e81 expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.356563:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e56b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.356577:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e56b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.356589:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e56b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.356605:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e572 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.356612:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.356618:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.356950:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e579 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.356961:0:9629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e42 expref: 26 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.356969:0:9629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e579 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.357006:0:9629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e42 expref: 26 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855895.357018:0:9629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e42 expref: 26 pid: 9629 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855895.357033:0:9629:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa9c0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9629:1874702486288896:192.168.201.38@tcp:104: 00000100:00100000:2.0:1787855895.357138:0:9629:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cc840 going to sleep for 11 seconds 00000100:00100000:1.0:1787855895.365107:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855895.365207:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464287872 00000100:00100000:0.0:1787855895.365217:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464287872 00000100:00100000:0.0:1787855895.365278:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:0.0:1787855895.365289:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df8492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+27:11616:x1874702464287872:12345-192.168.201.38@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787855895.365561:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df8492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+28:11616:x1874702464287872:12345-192.168.201.38@tcp:35:ldlm_bl.0 Request processed in 273us (464us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787855895.365569:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 63 00000100:00100000:2.0:1787855895.368201:0:9629:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa9c0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9629:1874702486288896:192.168.201.38@tcp:104: 00010000:00010000:2.0:1787855895.368231:0:9629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e579 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855895.368672:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855895.368877:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464288000 00000100:00100000:1.0:1787855895.368885:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464288000 00010000:00010000:1.0:1787855895.368923:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e42 expref: 28 pid: 9629 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855895.368971:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:1.0:1787855895.368982:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c5548450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+28:2357:x1874702464288000:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787855895.368998:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855895.369006:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e42 expref: 28 pid: 9629 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855895.369020:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e42 expref: 28 pid: 9629 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855895.369051:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887200/0x516929ca3366e484 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e42 expref: 28 pid: 9629 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855895.369092:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:1.0:1787855895.369098:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e579 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855895.369108:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855895.369116:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e579 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855895.369150:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855895.369207:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c5548450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+27:2357:x1874702464288000:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 226us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855895.369215:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 86 00010000:00010000:3.0:1787855895.370075:0:9629:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370096:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855895.370142:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787855895.370147:0:9629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787855895.370169:0:9629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370184:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e579 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370193:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e56b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370199:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e56b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370207:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e56b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370212:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855895.370217:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e56b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370224:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e56b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370234:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:3.0:1787855895.370246:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855895.370251:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e56b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370257:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887c00/0x516929ca3366e56b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370270:0:9629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e572 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370275:0:9629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e572 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370280:0:9629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e572 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370285:0:9629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886c00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855895.370287:0:9629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e572 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370292:0:9629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e572 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370299:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a73c7093700) 00010000:00010000:3.0:1787855895.370301:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787855895.370303:0:9629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e572 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370308:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886c00/0x516929ca3366e572 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370341:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887e00/0x516929ca3366e564 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e81 expref: 27 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370365:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e579 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e81 expref: 26 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855895.370372:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:3.0:1787855895.370374:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787855895.370376:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887000, rc 0) 00000100:00100000:3.0:1787855895.370430:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+26:11619:x1874702464287616:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 13990us (14244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855895.370438:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 232 00010000:00010000:1.0:1787855896.321394:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787855896.321579:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787855896.321585:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787855896.321695:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787855896.321702:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787855896.322438:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84bc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874702486289024:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787855896.322538:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e74ac6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787855896.326235:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855896.326797:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84bc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11670:1874702486289024:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787855896.328742:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464288128 00000100:00100000:2.0:1787855896.328756:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464288128 00000100:00100000:2.0:1787855896.328844:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 233 00000100:00100000:2.0:1787855896.328857:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+26:11630:x1874702464288128:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787855896.328892:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787855896.329004:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+26:11630:x1874702464288128:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 151us (2778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855896.329012:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 233 00000100:00080000:1.0:1787855896.329580:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855896.334913:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855896.334967:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464288384 00000100:00100000:1.0:1787855896.334976:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464288384 00000100:00100000:1.0:1787855896.335038:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 234 00000100:00100000:1.0:1787855896.335062:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+26:11630:x1874702464288384:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787855896.335083:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855896.335102:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e580 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e88 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855896.335196:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366e587 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855896.335210:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366e587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855896.335221:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366e587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787855896.335233:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787855896.335708:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff800/0x516929ca3366e580 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e88 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855896.335723:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366e587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e88 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855896.335731:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:1.0:1787855896.335734:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787855896.335738:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fea00, rc 0) 00000100:00100000:1.0:1787855896.335875:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+28:11630:x1874702464288384:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 814us (970us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787855896.335884:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 234 00000100:00100000:1.0:1787855896.341389:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855896.341429:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855896.341823:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464288640 00000100:00100000:2.0:1787855896.341835:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464288640 00000100:00100000:2.0:1787855896.341998:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 235 00000100:00100000:2.0:1787855896.342010:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+28:11630:x1874702464288640:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787855896.342097:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e595 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855896.342118:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855896.342128:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855896.342306:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855896.342314:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e595 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855896.342320:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e595 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855896.342326:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787855896.342330:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e595 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855896.342337:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e595 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855896.342349:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:2.0:1787855896.342352:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787855896.342357:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e595 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855896.342363:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886e00/0x516929ca3366e595 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787855896.343097:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787855896.343104:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1787855896.343637:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+29:11630:x1874702464288640:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 1624us (2251us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787855896.343655:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 235 00000040:00080000:1.0:1787855896.344089:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787855896.344099:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787855896.344230:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464288768 00000100:00100000:3.0:1787855896.344239:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464288768 00000100:00100000:3.0:1787855896.344301:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:3.0:1787855896.344310:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+29:2360:x1874702464288768:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787855896.344325:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787855896.344345:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fea00/0x516929ca3366e587 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e88 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855896.344361:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:3.0:1787855896.344365:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787855896.344409:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+28:2360:x1874702464288768:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 100us (2979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855896.344415:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:1.0:1787855896.355138:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855896.355227:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464289024 00000100:00100000:0.0:1787855896.355238:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464289024 00000100:00100000:0.0:1787855896.355296:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 64 00000100:00100000:0.0:1787855896.355306:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+28:11630:x1874702464289024:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787855896.355561:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+29:11630:x1874702464289024:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 255us (432us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787855896.355569:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 64 00000040:00080000:2.0:1787855896.402883:0:12556:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787855896.402895:0:12556:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787855896.413802:0:12556:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787855896.413812:0:12556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787855896.628313:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855896.629019:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464289280 00000100:00100000:3.0:1787855896.629030:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464289280 00000100:00100000:3.0:1787855896.629810:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 236 00000100:00100000:3.0:1787855896.629824:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+29:11643:x1874702464289280:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787855896.629849:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855896.629870:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e59c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e8f expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855896.629999:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e5a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855896.630023:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e5a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855896.630034:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e5a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855896.630045:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787855896.630750:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166ce00/0x516929ca3366e59c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e8f expref: 32 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855896.630796:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e5a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e8f expref: 31 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855896.630807:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:3.0:1787855896.630810:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787855896.630813:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166c000, rc 0) 00000100:00100000:3.0:1787855896.630881:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+31:11643:x1874702464289280:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1060us (2576us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787855896.631243:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 236 00000100:00100000:0.0:1787855896.634332:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855896.637159:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464289408 00000100:00100000:3.0:1787855896.637180:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464289408 00000100:00100000:3.0:1787855896.637241:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 237 00000100:00100000:3.0:1787855896.637252:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+31:11643:x1874702464289408:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:3.0:1787855896.637316:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e5b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855896.637333:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855896.637345:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855896.637372:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855896.637379:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e5b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855896.637386:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855896.637391:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166d000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787855896.637395:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855896.637403:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e5b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855896.637414:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:3.0:1787855896.637417:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787855896.637421:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e5b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855896.637436:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e5b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855896.637514:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+31:11643:x1874702464289408:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 264us (3190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855896.637522:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 237 00000100:00100000:3.0:1787855896.706461:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855896.707001:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464289536 00000100:00100000:1.0:1787855896.707024:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464289536 00000100:00100000:1.0:1787855896.707106:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 71 00000100:00100000:1.0:1787855896.707118:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2360:x1874702464289536:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:1.0:1787855896.707137:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855896.707162:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e5b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e96 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787855896.707192:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a908416, atime: 0x6a908416, ctime: 0x6a908416, blocks: 0xb 00010000:00010000:1.0:1787855896.707214:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=387s v=(0 0) 00010000:00010000:1.0:1787855896.707219:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787855896.707229:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e5b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e96 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855896.707246:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e5b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e96 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855896.707261:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ffe00, rc 0) 00000100:00100000:1.0:1787855896.707338:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2360:x1874702464289536:12345-192.168.201.38@tcp:101:cat.0 Request processed in 223us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855896.707345:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 71 00000100:00100000:3.0:1787855896.713210:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855896.713328:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464289664 00000100:00100000:1.0:1787855896.713360:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464289664 00002000:00100000:1.0:1787855896.713423:0:6686:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9a73fa9dc000 x1874702464289664/t0(0) o3->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:52/0 lens 488/0 e 0 to 0 dl 1787855907 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787855896.713435:0:6686:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73fa9dc000 with x1874702464289664 ext(0->4095) 00002000:00010000:1.0:1787855896.713441:0:6686:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a73fa9dc000 00000100:00100000:1.0:1787855896.713492:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:1.0:1787855896.713502:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2359:x1874702464289664:12345-192.168.201.38@tcp:3:cat.0 00000100:00100000:1.0:1787855896.713729:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2359:x1874702464289664:12345-192.168.201.38@tcp:3:cat.0 Request processed in 227us (534us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787855896.713737:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00002000:00100000:1.0:1787855896.713744:0:6686:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9a73fa9dc000 x1874702464289664/t0(0) o3->6933b672-fa85-4aae-9dc8-092c3f355bbf@192.168.201.38@tcp:52/0 lens 488/4536 e 0 to 0 dl 1787855907 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787855896.713752:0:6686:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff9a73fa9dc000 with x1874702464289664 ext(0->4095) 00002000:00010000:1.0:1787855896.713756:0:6686:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a73fa9dc000 00010000:00010000:2.0:1787855897.340280:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855898.364759:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855898.749819:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73fa9dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486289152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787855898.749897:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855898.750120:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486289152 00000100:00100000:3.0:1787855898.750128:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486289152 00000100:00080000:1.0:1787855898.750178:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787855898.750189:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787855898.750200:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874702486289152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787855898.750236:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855898.750302:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874702486289152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855898.750310:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787855898.750837:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73fa9dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486289152:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787855898.841348:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1787855898.841374:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1787855899.055377:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855899.055409:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855899.055427:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855899.055445:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855899.055463:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855899.055487:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464290304 00000100:00100000:2.0:1787855899.055495:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464290304 00000100:00100000:2.0:1787855899.055562:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464289920 00000100:00100000:2.0:1787855899.055566:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464289920 00000100:00100000:2.0:1787855899.055583:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 166 00000100:00100000:2.0:1787855899.055591:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2358:x1874702464290304:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855899.055655:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2358:x1874702464290304:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 65us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855899.055662:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 166 00000100:00100000:2.0:1787855899.055677:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 167 00000100:00100000:2.0:1787855899.055682:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+31:2358:x1874702464289920:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855899.055702:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+31:2358:x1874702464289920:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 21us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855899.055708:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 167 00000100:00080000:1.0:1787855899.057188:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855899.057936:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464290048 00000100:00100000:3.0:1787855899.057948:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464290048 00000100:00100000:3.0:1787855899.058014:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464290176 00000100:00100000:3.0:1787855899.058017:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464290176 00000100:00100000:3.0:1787855899.058047:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:3.0:1787855899.058058:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2358:x1874702464290048:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855899.058137:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+8:2358:x1874702464290048:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 82us (2727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855899.058145:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:3.0:1787855899.058160:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:3.0:1787855899.058184:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2358:x1874702464290176:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787855899.058209:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2358:x1874702464290176:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (2746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855899.058215:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:0.0:1787855899.058431:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464289792 00000100:00100000:0.0:1787855899.058437:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464289792 00000100:00100000:0.0:1787855899.058467:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 299 00000100:00100000:0.0:1787855899.058473:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2358:x1874702464289792:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855899.058508:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2358:x1874702464289792:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 35us (3139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855899.058515:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 299 00000100:00080000:3.0:1787855899.058686:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787855899.058690:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787855899.260682:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486289408:0@lo:400:kworker.0 00000100:00100000:3.0:1787855899.260757:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855899.260844:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df848f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486289920:0@lo:400:kworker.0 00000100:00100000:3.0:1787855899.260885:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855899.260888:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df848780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486289664:0@lo:400:kworker.0 00000100:00100000:3.0:1787855899.260916:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787855899.260917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855899.260922:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486289536:0@lo:400:kworker.0 00000100:00100000:0.0:1787855899.260937:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787855899.260943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855899.260943:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df849a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486289280:0@lo:400:kworker.0 00000100:00100000:0.0:1787855899.260969:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855899.260974:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486289920 00000100:00100000:3.0:1787855899.260981:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486289920 00000100:00100000:0.0:1787855899.260989:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df849680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874702486289792:0@lo:400:kworker.0 00000100:00100000:0.0:1787855899.261008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855899.261029:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486289664 00000100:00100000:0.0:1787855899.261030:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486289280 00000100:00100000:3.0:1787855899.261032:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486289664 00000100:00100000:0.0:1787855899.261032:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486289280 00000100:00100000:3.0:1787855899.261052:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787855899.261053:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787855899.261060:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486289920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855899.261060:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3306:x1874702486289280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855899.261104:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486289920:12345-0@lo:400:kworker.0 Request processed in 45us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855899.261111:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787855899.261117:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3306:x1874702486289280:12345-0@lo:400:kworker.0 Request processed in 59us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855899.261123:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787855899.261127:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787855899.261132:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1874702486289664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855899.261159:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1874702486289664:12345-0@lo:400:kworker.0 Request processed in 27us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855899.261163:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df849a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486289280:0@lo:400:kworker.0 00000100:00100000:0.0:1787855899.261176:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df848780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486289664:0@lo:400:kworker.0 00000100:00100000:3.0:1787855899.261181:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787855899.261202:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486289408 00000100:00100000:3.0:1787855899.261205:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486289408 00000100:00100000:0.0:1787855899.261212:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486289536 00000100:00100000:0.0:1787855899.261215:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486289536 00000100:00100000:1.0:1787855899.261269:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486289792 00000100:00100000:1.0:1787855899.261273:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486289792 00000100:00080000:2.0:1787855899.261338:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787855899.261368:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787855899.261373:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1787855899.261389:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a73ffd2e1c0, transno 4294967310 00000100:00100000:2.0:1787855899.261402:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df848f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486289920:0@lo:400:kworker.0 00000100:00100000:3.0:1787855899.261479:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787855899.268615:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787855899.268631:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486289536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855899.268730:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486289536:12345-0@lo:400:kworker.0 Request processed in 103us (7785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855899.268752:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:2.0:1787855899.269146:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855899.269187:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486289536:0@lo:400:kworker.0 00000100:00100000:1.0:1787855899.271706:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787855899.271722:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874702486289792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855899.271860:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874702486289792:12345-0@lo:400:kworker.0 Request processed in 141us (10849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855899.271896:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787855899.271959:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df849680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874702486289792:0@lo:400:kworker.0 00000100:00080000:2.0:1787855899.272548:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855899.277376:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486289408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855899.277512:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486289408:12345-0@lo:400:kworker.0 Request processed in 16025us (16754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855899.277522:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787855899.277828:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486289408:0@lo:400:kworker.0 00010000:00010000:2.0:1787855899.388017:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855899.772356:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787855899.772390:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73ffd2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486290048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787855899.772490:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855899.780014:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486290048 00000100:00100000:0.0:1787855899.780037:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486290048 00000100:00100000:0.0:1787855899.780124:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787855899.780138:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486290048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787855899.780195:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855899.780322:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486290048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 187us (7832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855899.780332:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787855899.780372:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73ffd2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486290048:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787855900.368467:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1787855900.368483:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1787855900.369438:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:1.0:1787855900.369456:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a73c2da3a80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787855900.369461:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a73fa6cb500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a73c2da3f00 00000020:00080000:1.0:1787855900.369464:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a73fa6cb900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a73f9db8c00 00000001:00080000:1.0:1787855900.369694:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1787855900.369704:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1787855900.371918:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1787855900.373429:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1787855900.412935:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855901.436219:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855902.250719:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855902.255251:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464290432 00000100:00100000:2.0:1787855902.255267:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464290432 00000100:00100000:2.0:1787855902.255424:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 238 00000100:00100000:2.0:1787855902.255437:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:11295:x1874702464290432:12345-192.168.201.38@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787855902.255557:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:11295:x1874702464290432:12345-192.168.201.38@tcp:60:lhsmtool_posix.0 Request processed in 122us (4847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855902.255564:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 238 00000100:00080000:3.0:1787855902.261111:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855902.263498:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855902.265810:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464290688 00000100:00100000:1.0:1787855902.265832:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464290688 00000100:00100000:1.0:1787855902.265986:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 65 00000100:00100000:1.0:1787855902.265998:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:11295:x1874702464290688:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787855902.266501:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:11295:x1874702464290688:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 504us (3011us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787855902.266510:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 65 00010000:00010000:1.0:1787855902.461155:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855902.585574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855902.585712:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464290816 00000100:00100000:3.0:1787855902.585720:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464290816 00000100:00100000:3.0:1787855902.585833:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 239 00000100:00100000:3.0:1787855902.585844:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:12095:x1874702464290816:12345-192.168.201.38@tcp:101:lsof.0 00010000:00010000:3.0:1787855902.585864:0:9629:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855902.585887:0:9629:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e5bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616e9d expref: -99 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787855902.586112:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787855902.586181:0:9629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e5c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855902.586194:0:9629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855902.586205:0:9629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787855902.586500:0:9629:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787855902.586505:0:9629:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787855902.586652:0:9629:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9629 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855902.586680:0:9629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d000/0x516929ca3366e5bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e9d expref: 7 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855902.586698:0:9629:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e9d expref: 6 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855902.586706:0:9629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40aca00) 00010000:00010000:3.0:1787855902.586709:0:9629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787855902.586712:0:9629:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166d600, rc 0) 00000100:00100000:3.0:1787855902.586882:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:12095:x1874702464290816:12345-192.168.201.38@tcp:101:lsof.0 Request processed in 1039us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855902.586890:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 239 00010000:00010000:3.0:1787855903.484102:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855903.868256:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787855903.868280:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486290176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787855903.868351:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855903.868442:0:12311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486290176 00000100:00100000:2.0:1787855903.868464:0:12311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486290176 00000100:00100000:2.0:1787855903.868524:0:12311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787855903.868533:0:12311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486290176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787855903.868567:0:12311:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787855903.868611:0:12311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486290176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855903.868618:0:12311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1787855903.868640:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787855903.868666:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1787855903.868671:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a73ffd2f480, transno 4294967322 00000004:00080000:2.0:1787855903.868681:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1787855903.868724:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486290176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855904.167446:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855904.167499:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855904.167631:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464291072 00000100:00100000:2.0:1787855904.167640:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464291072 00000100:00100000:2.0:1787855904.167714:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 171 00000100:00100000:2.0:1787855904.167727:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:2360:x1874702464291072:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855904.167889:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:2360:x1874702464291072:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 154us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855904.167897:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 171 00000100:00080000:1.0:1787855904.168041:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855904.168707:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855904.168742:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855904.168816:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464290944 00000100:00100000:1.0:1787855904.168823:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464290944 00000100:00100000:1.0:1787855904.168885:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 301 00000100:00100000:1.0:1787855904.168895:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2359:x1874702464290944:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855904.168979:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2359:x1874702464290944:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 85us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855904.168987:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 301 00000100:00100000:3.0:1787855904.174326:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855904.174468:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464291456 00000100:00100000:1.0:1787855904.174478:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464291456 00000100:00100000:1.0:1787855904.174550:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 172 00000100:00100000:1.0:1787855904.174561:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:2359:x1874702464291456:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787855904.174653:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:2359:x1874702464291456:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 93us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855904.174660:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 172 00000100:00080000:3.0:1787855904.176660:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855904.192130:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464291328 00000100:00100000:0.0:1787855904.192146:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464291328 00000100:00100000:0.0:1787855904.192244:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464291200 00000100:00100000:0.0:1787855904.192248:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464291200 00000100:00100000:0.0:1787855904.192293:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:0.0:1787855904.192304:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fab830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2360:x1874702464291328:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855904.192388:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fab830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2360:x1874702464291328:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 86us (24888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855904.192396:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00080000:1.0:1787855904.192402:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787855904.192409:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787855904.192420:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:0.0:1787855904.192429:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2359:x1874702464291200:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855904.192461:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2359:x1874702464291200:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 34us (23719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855904.192468:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:3.0:1787855904.380695:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486290560:0@lo:400:kworker.0 00000100:00100000:3.0:1787855904.380807:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855904.381026:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486290560 00000100:00100000:1.0:1787855904.381034:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486290560 00000100:00100000:1.0:1787855904.381090:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787855904.381099:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9de5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486290560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855904.381149:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9de5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486290560:12345-0@lo:400:kworker.0 Request processed in 52us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855904.381156:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:1.0:1787855904.381182:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855904.381248:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486290688:0@lo:400:kworker.0 00000100:00100000:0.0:1787855904.381309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855904.381337:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787855904.381344:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486290304:0@lo:400:kworker.0 00000100:00100000:0.0:1787855904.381373:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855904.381395:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874702486290816:0@lo:400:kworker.0 00000100:00100000:0.0:1787855904.381416:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855904.381441:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486290304 00000100:00100000:0.0:1787855904.381445:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486290304 00000100:00100000:0.0:1787855904.381473:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787855904.381479:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3306:x1874702486290304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855904.381514:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3306:x1874702486290304:12345-0@lo:400:kworker.0 Request processed in 35us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855904.381520:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787855904.381563:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486290304:0@lo:400:kworker.0 00000100:00100000:0.0:1787855904.381586:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486290816 00000100:00100000:0.0:1787855904.381590:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486290816 00000100:00100000:0.0:1787855904.381620:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787855904.381626:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874702486290816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855904.381658:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874702486290816:12345-0@lo:400:kworker.0 Request processed in 32us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855904.381665:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:0.0:1787855904.381677:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787855904.381694:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874702486290816:0@lo:400:kworker.0 00000100:00100000:1.0:1787855904.381914:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486290688 00000100:00100000:1.0:1787855904.381918:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486290688 00000100:00100000:1.0:1787855904.381951:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787855904.381958:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486290688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855904.381993:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486290688:12345-0@lo:400:kworker.0 Request processed in 36us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855904.382015:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787855904.382134:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787855904.382151:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486290432:0@lo:400:kworker.0 00000100:00100000:3.0:1787855904.382179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855904.382208:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486290944:0@lo:400:kworker.0 00000100:00100000:3.0:1787855904.382231:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855904.382253:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486290560:0@lo:400:kworker.0 00000100:00100000:1.0:1787855904.382459:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486290432 00000100:00100000:1.0:1787855904.382464:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486290432 00000100:00100000:1.0:1787855904.382498:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787855904.382504:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486290432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855904.382539:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486290432:12345-0@lo:400:kworker.0 Request processed in 36us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855904.382545:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787855904.382852:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486290944 00000100:00100000:0.0:1787855904.382864:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486290944 00000100:00100000:0.0:1787855904.382923:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787855904.382929:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486290944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855904.382967:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486290944:12345-0@lo:400:kworker.0 Request processed in 38us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855904.382973:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787855904.383006:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486290688:0@lo:400:kworker.0 00000100:00080000:1.0:1787855904.383167:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787855904.383410:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486290432:0@lo:400:kworker.0 00000100:00100000:3.0:1787855904.383421:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486290944:0@lo:400:kworker.0 00010000:00010000:1.0:1787855904.508159:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787855904.572154:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787855904.572163:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787855904.578223:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1787855904.578237:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787855904.896029:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73ffd2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486291072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787855904.896120:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855904.897320:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486291072 00000100:00100000:0.0:1787855904.897332:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486291072 00000100:00100000:0.0:1787855904.897409:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787855904.897420:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa23e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486291072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787855904.897460:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855904.897542:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa23e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486291072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855904.897881:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73ffd2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486291072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787855904.898222:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000001:00080000:3.0:1787855905.505571:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1787855905.505583:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1787855905.505632:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1787855905.505644:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1787855905.532085:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855906.568492:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787855906.605108:0:12759:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:38:25 (1787855905) 00010000:00010000:3.0:1787855907.588653:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855908.606963:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855908.989006:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787855908.989038:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486291200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787855908.989133:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855908.989281:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486291200 00000100:00100000:3.0:1787855908.989292:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486291200 00000100:00100000:3.0:1787855908.989362:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787855908.989373:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486291200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787855908.989420:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855908.989471:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486291200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855908.989479:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787855908.991190:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486291200:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787855908.992145:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787855909.286132:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855909.286263:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855909.286303:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855909.286334:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855909.286363:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855909.286396:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464291584 00000100:00100000:0.0:1787855909.286408:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464291584 00000100:00100000:0.0:1787855909.286474:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 303 00000100:00100000:2.0:1787855909.286583:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464291712 00000100:00100000:2.0:1787855909.286590:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464291712 00000100:00100000:2.0:1787855909.286659:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464292096 00000100:00100000:2.0:1787855909.286663:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464292096 00000100:00100000:2.0:1787855909.286686:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 176 00000100:00100000:2.0:1787855909.286706:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:2358:x1874702464291712:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855909.286829:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:2358:x1874702464291712:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 136us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855909.286838:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 176 00000100:00100000:2.0:1787855909.286859:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 177 00000100:00100000:2.0:1787855909.286866:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:2358:x1874702464292096:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787855909.286893:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:2358:x1874702464292096:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855909.286899:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 177 00000100:00100000:0.0:1787855909.287274:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2358:x1874702464291584:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855909.287320:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2358:x1874702464291584:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 820us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855909.287328:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 303 00000100:00100000:0.0:1787855909.287367:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464291968 00000100:00100000:0.0:1787855909.287372:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464291968 00000100:00100000:0.0:1787855909.287402:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464291840 00000100:00100000:0.0:1787855909.287405:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464291840 00000100:00100000:0.0:1787855909.287431:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 89 00000100:00100000:0.0:1787855909.287438:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73ffd2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2358:x1874702464291968:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855909.287467:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73ffd2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2358:x1874702464291968:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 30us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855909.287473:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 89 00000100:00100000:0.0:1787855909.287484:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00100000:0.0:1787855909.287490:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2358:x1874702464291840:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787855909.288869:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2358:x1874702464291840:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 1112us (2268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855909.288884:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00080000:0.0:1787855909.288929:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787855909.288935:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787855909.288939:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855909.500320:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb7a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486291328:0@lo:400:kworker.0 00000100:00100000:2.0:1787855909.500395:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855909.500447:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486291840:0@lo:400:kworker.0 00000100:00100000:2.0:1787855909.500474:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855909.500500:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787855909.500507:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e748b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486291712:0@lo:400:kworker.0 00000100:00100000:2.0:1787855909.500531:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855909.500559:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7488780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486291456:0@lo:400:kworker.0 00000100:00100000:2.0:1787855909.500582:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855909.500600:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486291968:0@lo:400:kworker.0 00000100:00100000:2.0:1787855909.500618:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855909.500634:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787855909.500639:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e748ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486291584:0@lo:400:kworker.0 00000100:00100000:2.0:1787855909.500677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855909.500720:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486291328 00000100:00100000:2.0:1787855909.500728:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486291328 00000100:00100000:2.0:1787855909.500771:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787855909.500875:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486291328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855909.500923:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486291328:12345-0@lo:400:kworker.0 Request processed in 51us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855909.500931:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787855909.500962:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486291840 00000100:00100000:2.0:1787855909.500965:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486291840 00000100:00100000:2.0:1787855909.500999:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486291456 00000100:00100000:2.0:1787855909.501003:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486291456 00000100:00100000:2.0:1787855909.501013:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486291584 00000100:00100000:2.0:1787855909.501015:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486291584 00000100:00100000:2.0:1787855909.501041:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787855909.501048:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486291840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855909.501081:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486291840:12345-0@lo:400:kworker.0 Request processed in 32us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855909.501086:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787855909.501097:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787855909.501102:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486291456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855909.501553:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486291456:12345-0@lo:400:kworker.0 Request processed in 449us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855909.501560:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787855909.501575:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787855909.501582:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486291584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855909.501611:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486291584:12345-0@lo:400:kworker.0 Request processed in 29us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855909.501625:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787855909.501645:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486291712 00000100:00100000:2.0:1787855909.501650:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486291712 00000100:00100000:2.0:1787855909.501675:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486291968 00000100:00100000:2.0:1787855909.501678:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486291968 00000100:00100000:2.0:1787855909.501714:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787855909.501720:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486291712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855909.501752:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9c3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486291712:12345-0@lo:400:kworker.0 Request processed in 31us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855909.501758:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787855909.501769:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787855909.501800:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1322940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486291968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855909.503070:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e748ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486291584:0@lo:400:kworker.0 00000100:00100000:3.0:1787855909.503091:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7488780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486291456:0@lo:400:kworker.0 00000100:00100000:3.0:1787855909.503127:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7489680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486291968:0@lo:400:kworker.0 00000100:00100000:2.0:1787855909.504948:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1322940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486291968:12345-0@lo:400:kworker.0 Request processed in 57us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855909.504970:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1787855909.505828:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787855909.505836:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855909.505897:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e748b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486291712:0@lo:400:kworker.0 00000100:00100000:2.0:1787855909.507236:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb7a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486291328:0@lo:400:kworker.0 00000100:00100000:2.0:1787855909.507253:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486291840:0@lo:400:kworker.0 00010000:00010000:2.0:1787855909.628199:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855910.012068:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787855910.012089:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486292096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787855910.012157:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855910.012262:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486292096 00000100:00100000:0.0:1787855910.012269:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486292096 00000100:00100000:0.0:1787855910.012311:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787855910.012317:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb7a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486292096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787855910.012349:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787855910.012407:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb7a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486292096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855910.012412:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787855910.012544:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486292096:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787855910.652298:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855911.677709:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855912.154731:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855912.154845:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464292352 00000100:00100000:1.0:1787855912.154854:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464292352 00000100:00100000:1.0:1787855912.154936:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00100000:1.0:1787855912.154948:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+18:12317:x1874702464292352:12345-192.168.201.38@tcp:35:umount.0 00000100:00100000:1.0:1787855912.155543:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7489680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:12317:x1874702464292352:12345-192.168.201.38@tcp:35:umount.0 Request processed in 595us (818us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787855912.155550:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 66 00000100:00080000:2.0:1787855912.155629:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787855912.158049:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855912.158151:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464292608 00000100:00100000:3.0:1787855912.158161:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464292608 00000100:00100000:3.0:1787855912.158218:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:3.0:1787855912.158229:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df848b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+19:12317:x1874702464292608:12345-192.168.201.38@tcp:35:umount.0 00000100:00100000:3.0:1787855912.158826:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df848b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+20:12317:x1874702464292608:12345-192.168.201.38@tcp:35:umount.0 Request processed in 599us (787us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787855912.158834:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 67 00000100:00100000:3.0:1787855912.160093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855912.160229:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464292864 00000100:00100000:0.0:1787855912.160242:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464292864 00000100:00100000:0.0:1787855912.160315:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:3.0:1787855912.160324:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1787855912.160326:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73dc21d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+20:12317:x1874702464292864:12345-192.168.201.38@tcp:35:umount.0 00000100:00100000:3.0:1787855912.160334:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1787855912.160920:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73dc21d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:12317:x1874702464292864:12345-192.168.201.38@tcp:35:umount.0 Request processed in 589us (822us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787855912.160931:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 68 00000100:00100000:0.0:1787855912.162249:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855912.162340:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464293120 00000100:00100000:3.0:1787855912.162350:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464293120 00000100:00100000:3.0:1787855912.162444:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:3.0:1787855912.162464:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:12317:x1874702464293120:12345-192.168.201.38@tcp:35:umount.0 00000100:00100000:3.0:1787855912.162835:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+22:12317:x1874702464293120:12345-192.168.201.38@tcp:35:umount.0 Request processed in 372us (589us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787855912.162843:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 69 00000100:00100000:2.0:1787855912.164731:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855912.164842:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855912.164882:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855912.164920:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464293504 00000100:00100000:0.0:1787855912.164928:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464293504 00000100:00100000:1.0:1787855912.164945:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464293248 00000100:00100000:1.0:1787855912.164948:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464293248 00000100:00100000:1.0:1787855912.165025:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464293376 00000100:00100000:1.0:1787855912.165029:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464293376 00000100:00100000:2.0:1787855912.165273:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:0.0:1787855912.165280:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:2.0:1787855912.165285:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1379a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d78451b-7acd-4478-9bc5-3a00d72e2604+15:2360:x1874702464293248:12345-192.168.201.38@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787855912.165286:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7422580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d78451b-7acd-4478-9bc5-3a00d72e2604+15:2359:x1874702464293504:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855912.165301:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855912.165301:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855912.165325:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402173800/0x516929ca3366d5a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c9306169f0 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.165326:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402046400/0x516929ca3366d5dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a28 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.165345:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787855912.165345:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855912.165396:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1379a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2360:x1874702464293248:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 113us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855912.165396:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7422580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d78451b-7acd-4478-9bc5-3a00d72e2604+13:2359:x1874702464293504:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 109us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855912.165403:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:2.0:1787855912.165411:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:0.0:1787855912.165420:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:0.0:1787855912.165428:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1378780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:2359:x1874702464293376:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855912.165435:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855912.165472:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402047200/0x516929ca3366d828 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616af3 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855912.165481:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855912.165500:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1378780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d78451b-7acd-4478-9bc5-3a00d72e2604+10:2359:x1874702464293376:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 73us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855912.165506:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:2.0:1787855912.167203:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787855912.167250:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464293632 00000100:00100000:3.0:1787855912.167257:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464293632 00000100:00080000:2.0:1787855912.167298:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787855912.167321:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:3.0:1787855912.167332:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df8061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+5:2356:x1874702464293632:12345-192.168.201.38@tcp:9:umount.0 00000020:00000080:3.0:1787855912.167364:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d916 00000100:00080000:3.0:1787855912.167375:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9a73d22ea000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787855912.167436:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1787855912.167466:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855912.167920:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df8061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6933b672-fa85-4aae-9dc8-092c3f355bbf+2:2356:x1874702464293632:12345-192.168.201.38@tcp:9:umount.0 Request processed in 589us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855912.167929:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 72 00000100:00100000:2.0:1787855912.172509:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855912.172686:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464294016 00000100:00100000:0.0:1787855912.172698:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464294016 00000100:00080000:2.0:1787855912.172762:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787855912.172807:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:0.0:1787855912.172820:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df806d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+7:2356:x1874702464294016:12345-192.168.201.38@tcp:9:umount.0 00000020:00000080:0.0:1787855912.172861:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366db77 00000020:00010000:0.0:1787855912.172871:0:6680:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a7400498000: total 0 00000100:00080000:0.0:1787855912.172876:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9a740049e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787855912.172923:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:2.0:1787855912.172946:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a7400498000: total 0 00010000:00010000:2.0:1787855912.172986:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a7400498000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787855912.173056:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b634f69c/0x516929ca3366df1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cc8 expref: 6 pid: 8077 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.173113:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075d5ddf1/0x516929ca3366e5b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e96 expref: 5 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.173143:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a7400498000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787855912.173156:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855912.173158:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855912.173160:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855912.173342:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df806d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6933b672-fa85-4aae-9dc8-092c3f355bbf+2:2356:x1874702464294016:12345-192.168.201.38@tcp:9:umount.0 Request processed in 524us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855912.173351:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 73 00000100:00100000:2.0:1787855912.182539:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855912.182599:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464295040 00000100:00100000:0.0:1787855912.182611:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464295040 00000100:00100000:0.0:1787855912.182694:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 240 00000100:00100000:0.0:1787855912.182707:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df807840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+22:2356:x1874702464295040:12345-192.168.201.38@tcp:39:umount.0 00000020:00000080:0.0:1787855912.182751:0:5835:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d5b2 00000020:00010000:0.0:1787855912.182772:0:5835:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a73fa532800: total 0 00000100:00080000:0.0:1787855912.182813:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9a73fa3cd800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787855912.182847:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1787855912.183271:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df807840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6933b672-fa85-4aae-9dc8-092c3f355bbf+21:2356:x1874702464295040:12345-192.168.201.38@tcp:39:umount.0 Request processed in 565us (741us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787855912.183300:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 240 00000020:00010000:2.0:1787855912.185189:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a73fa532800: total 0 00010000:00010000:2.0:1787855912.185196:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855912.185243:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a73fa532800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787855912.185595:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:2.0:1787855912.185605:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787855912.185619:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887400/0x516929ca3366dedb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cb3 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.185663:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:2.0:1787855912.185666:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787855912.185671:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366df05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616cc1 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.185717:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:2.0:1787855912.185721:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787855912.185725:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7887000/0x516929ca3366e579 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e81 expref: 18 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.185739:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40aca00) 00010000:00010000:2.0:1787855912.185742:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787855912.185745:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366df7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ce4 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.185844:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:2.0:1787855912.185848:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787855912.185856:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166c000/0x516929ca3366e5a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e8f expref: 16 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.186042:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:2.0:1787855912.186045:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787855912.186051:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fee00/0x516929ca3366dbd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616bef expref: 15 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.186068:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a73c7093c00) 00010000:00010000:2.0:1787855912.186070:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787855912.186074:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046200/0x516929ca3366d87c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b01 expref: 14 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.186093:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:2.0:1787855912.186095:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787855912.186100:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366e277 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616dbd expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.186114:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a73c7093500) 00010000:00010000:2.0:1787855912.186117:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787855912.186120:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a7402046e00/0x516929ca3366d8ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b1d expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.186132:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a73d40acf00) 00010000:00010000:2.0:1787855912.186135:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787855912.186145:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366e499 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e49 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.186163:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a73c7093b00) 00010000:00010000:2.0:1787855912.186166:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787855912.186169:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73f7886000/0x516929ca3366df98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ceb expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.186183:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a73c8d1dd00) 00010000:00010000:2.0:1787855912.186185:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787855912.186188:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff200/0x516929ca3366ddfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616c7b expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.186201:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a73d40ac700) 00010000:00010000:2.0:1787855912.186204:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787855912.186207:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229c00/0x516929ca3366d898 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616b08 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855912.186219:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a73fa532800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787855912.186249:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855912.186252:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855912.186254:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855912.700087:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855913.033311:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855913.033367:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855913.033475:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464295296 00000100:00100000:0.0:1787855913.033486:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464295296 00000100:00100000:0.0:1787855913.033545:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464295168 00000100:00100000:0.0:1787855913.033548:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464295168 00000100:00100000:0.0:1787855913.033578:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:0.0:1787855913.033587:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c9281a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:2359:x1874702464295296:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787855913.033602:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855913.033622:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c5143c00/0x516929ca3366d68b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a67 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855913.033730:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:2.0:1787855913.033740:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74443c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d78451b-7acd-4478-9bc5-3a00d72e2604+11:2359:x1874702464295168:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787855913.033749:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855913.033771:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c5143200/0x516929ca3366d684 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a3d expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855913.033819:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787855913.034133:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855913.034357:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74443c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3d78451b-7acd-4478-9bc5-3a00d72e2604+9:2359:x1874702464295168:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 617us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855913.034366:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:0.0:1787855913.034417:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c9281a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3d78451b-7acd-4478-9bc5-3a00d72e2604+8:2359:x1874702464295296:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 830us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855913.034424:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:2.0:1787855913.036881:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787855913.038209:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464295424 00000100:00100000:1.0:1787855913.038237:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464295424 00000100:00100000:1.0:1787855913.038304:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:1.0:1787855913.038321:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c5549050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d78451b-7acd-4478-9bc5-3a00d72e2604+8:2360:x1874702464295424:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787855913.038338:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855913.038361:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73fa6ff600/0x516929ca3366d821 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616aec expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855913.038378:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855913.038443:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c5549050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3d78451b-7acd-4478-9bc5-3a00d72e2604+7:2360:x1874702464295424:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 130us (1569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855913.038451:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:1.0:1787855913.046297:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787855913.046425:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464295680 00000100:00100000:2.0:1787855913.046436:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464295680 00000100:00100000:2.0:1787855913.046523:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 241 00000100:00100000:2.0:1787855913.046536:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+6:2356:x1874702464295680:12345-192.168.201.38@tcp:39:umount.0 00000100:00080000:0.0:1787855913.046575:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1787855913.046581:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d699 00000020:00010000:2.0:1787855913.046593:0:5833:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a72c1b23000: total 0 00000100:00080000:2.0:1787855913.046600:0:5833:0:(import.c:65:import_set_state_nolock()) ffff9a72c1b21800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787855913.046640:0:5833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1787855913.046689:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a72c1b23000: total 0 00000100:00100000:2.0:1787855913.046943:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76a6c3f7-1d4d-422f-86c9-d52d89a6ee45+5:2356:x1874702464295680:12345-192.168.201.38@tcp:39:umount.0 Request processed in 409us (655us total) trans 4294967526 rc 0/0 00010000:00010000:3.0:1787855913.046948:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a72c1b23000, canceled 0 locks, left on hash table 1. 00000100:00100000:2.0:1787855913.046955:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 241 00010000:00010000:3.0:1787855913.047000:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73d40aca00) 00010000:00010000:3.0:1787855913.047007:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787855913.047021:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c166d600/0x516929ca3366e5c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616e9d expref: 4 pid: 9629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855913.047051:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a72c1b23000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787855913.047065:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855913.047067:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855913.047069:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855913.068244:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787855913.068426:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464295936 00000100:00100000:0.0:1787855913.068441:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464295936 00000100:00100000:0.0:1787855913.068514:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 305 00000100:00100000:0.0:1787855913.068525:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+7:2356:x1874702464295936:12345-192.168.201.38@tcp:251:umount.0 00000020:00000080:0.0:1787855913.068591:0:5826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d58f 00000020:00010000:0.0:1787855913.068602:0:5826:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a72c1320800: total 0 00000100:00080000:0.0:1787855913.068618:0:5826:0:(import.c:65:import_set_state_nolock()) ffff9a72c1322800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787855913.068716:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d78451b-7acd-4478-9bc5-3a00d72e2604+3:2356:x1874702464295936:12345-192.168.201.38@tcp:251:umount.0 Request processed in 193us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855913.068734:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 305 00000020:00010000:2.0:1787855913.068950:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a72c1320800: total 0 00010000:00010000:2.0:1787855913.068959:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855913.069013:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a72c1320800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787855913.069051:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402047e00/0x516929ca3366d5e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616a2f expref: 2 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855913.069072:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a72c1320800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787855913.069080:0:5822:0:(genops.c:885:class_export_put()) final put ffff9a72c1320800/3d78451b-7acd-4478-9bc5-3a00d72e2604 00010000:00010000:2.0:1787855913.069110:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855913.069128:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855913.069132:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787855913.069216:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a72c1320800/3d78451b-7acd-4478-9bc5-3a00d72e2604 for MGS 00000020:00000080:3.0:1787855913.069258:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a72c1322800 for MGS 00010000:00010000:2.0:1787855913.737207:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855914.112357:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7488780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486292224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787855914.112430:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855914.112520:0:12311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486292224 00000100:00100000:3.0:1787855914.112528:0:12311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486292224 00000100:00100000:3.0:1787855914.114372:0:12311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787855914.114387:0:12311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e748ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486292224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787855914.114428:0:12311:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787855914.118089:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787855914.121356:0:12311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e748ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486292224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6962us (8915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855914.121372:0:12311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787855914.123237:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7488780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486292224:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787855914.246707:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6933b672-fa85-4aae-9dc8-092c3f355bbf 00000020:00000080:3.0:1787855914.246717:0:7628:0:(genops.c:885:class_export_put()) final put ffff9a73d22ec000/6933b672-fa85-4aae-9dc8-092c3f355bbf 00000020:00000080:3.0:1787855914.246742:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73d22ec000/6933b672-fa85-4aae-9dc8-092c3f355bbf for lustre-OST0001 00000020:00000080:3.0:1787855914.246804:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a73d22ea000 for lustre-OST0001 00000100:00100000:2.0:1787855914.619985:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486292480:0@lo:400:kworker.0 00000100:00100000:2.0:1787855914.620045:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855914.620084:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7648f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486292992:0@lo:400:kworker.0 00000100:00100000:2.0:1787855914.620102:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855914.620128:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787855914.620134:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486292608:0@lo:400:kworker.0 00000100:00100000:2.0:1787855914.620158:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855914.620187:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486292480 00000100:00100000:2.0:1787855914.620194:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486292480 00000100:00100000:2.0:1787855914.620288:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486292608 00000100:00100000:2.0:1787855914.620291:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486292608 00000100:00100000:2.0:1787855914.620311:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787855914.620317:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cc254b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486292480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855914.620355:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cc254b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874702486292480:12345-0@lo:400:kworker.0 Request processed in 38us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855914.620361:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787855914.620371:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787855914.620375:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486292608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855914.620456:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486292608:12345-0@lo:400:kworker.0 Request processed in 80us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855914.620460:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787855914.620476:0:8077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486292992 00000100:00100000:2.0:1787855914.620484:0:8077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486292992 00000100:00100000:2.0:1787855914.620504:0:8077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787855914.620509:0:8077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb676940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486292992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855914.620541:0:8077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb676940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486292992:12345-0@lo:400:kworker.0 Request processed in 31us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855914.620548:0:8077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1787855914.620567:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787855914.620571:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855914.620686:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7445e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486292352:0@lo:400:kworker.0 00000100:00100000:3.0:1787855914.620723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855914.620742:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486292864:0@lo:400:kworker.0 00000100:00100000:3.0:1787855914.620757:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855914.620768:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787855914.620772:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400697840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486292736:0@lo:400:kworker.0 00000100:00100000:3.0:1787855914.620805:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855914.620821:0:9629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486292864 00000100:00100000:3.0:1787855914.620824:0:9629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486292864 00000100:00100000:3.0:1787855914.620845:0:9629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787855914.620849:0:9629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7488780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486292864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855914.620871:0:9629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7488780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486292864:12345-0@lo:400:kworker.0 Request processed in 22us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855914.620876:0:9629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787855914.620888:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486292736 00000100:00100000:3.0:1787855914.620890:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486292736 00000100:00100000:3.0:1787855914.620904:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787855914.620908:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7489680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486292736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855914.620925:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7489680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486292736:12345-0@lo:400:kworker.0 Request processed in 18us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855914.620930:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787855914.620940:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486292352 00000100:00100000:3.0:1787855914.620948:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486292352 00000100:00100000:3.0:1787855914.620977:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1787855914.620981:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c61d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486292352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855914.621001:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c61d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3307:x1874702486292352:12345-0@lo:400:kworker.0 Request processed in 20us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855914.621004:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:3.0:1787855914.621028:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787855914.621045:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400697840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486292736:0@lo:400:kworker.0 00000100:00100000:3.0:1787855914.621051:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7445e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486292352:0@lo:400:kworker.0 00000100:00100000:3.0:1787855914.621056:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486292864:0@lo:400:kworker.0 00000100:00100000:2.0:1787855914.621536:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400694000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486292608:0@lo:400:kworker.0 00000100:00100000:2.0:1787855914.621549:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874702486292480:0@lo:400:kworker.0 00000100:00100000:2.0:1787855914.621559:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7648f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486292992:0@lo:400:kworker.0 00010000:00010000:2.0:1787855914.748040:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787855914.812101:0:11670:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787855914.812121:0:11670:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787855914.812464:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787855914.812471:0:11670:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787855915.135100:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486293120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787855915.135181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855915.135657:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486293120 00000100:00100000:3.0:1787855915.135665:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486293120 00000100:00100000:3.0:1787855915.135719:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787855915.135729:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486293120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787855915.135764:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787855915.135851:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486293120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855915.135858:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787855915.136047:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dfed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486293120:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787855915.737422:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6933b672-fa85-4aae-9dc8-092c3f355bbf 00000020:00000080:1.0:1787855915.737430:0:6703:0:(genops.c:885:class_export_put()) final put ffff9a7400498000/6933b672-fa85-4aae-9dc8-092c3f355bbf 00000020:00000080:1.0:1787855915.737458:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a7400498000/6933b672-fa85-4aae-9dc8-092c3f355bbf for lustre-OST0000 00000020:00000080:1.0:1787855915.737499:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a740049e000 for lustre-OST0000 00000001:00100000:3.0:1787855915.742611:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6933b672-fa85-4aae-9dc8-092c3f355bbf 00000001:00080000:3.0:1787855915.742628:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:3.0:1787855915.742640:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 76a6c3f7-1d4d-422f-86c9-d52d89a6ee45 00000001:00080000:3.0:1787855915.742646:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1787855915.742664:0:5855:0:(genops.c:885:class_export_put()) final put ffff9a72c1b23000/76a6c3f7-1d4d-422f-86c9-d52d89a6ee45 00000020:00000080:3.0:1787855915.742700:0:5855:0:(genops.c:885:class_export_put()) final put ffff9a73fa532800/6933b672-fa85-4aae-9dc8-092c3f355bbf 00000020:00000080:1.0:1787855915.742747:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a72c1b23000/76a6c3f7-1d4d-422f-86c9-d52d89a6ee45 for lustre-MDT0000 00000020:00000080:1.0:1787855915.742836:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73fa532800/6933b672-fa85-4aae-9dc8-092c3f355bbf for lustre-MDT0000 00000020:00000080:1.0:1787855915.742867:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a72c1b21800 for lustre-MDT0000 00000020:00000080:1.0:1787855915.742877:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a73fa3cd800 for lustre-MDT0000 00010000:00010000:2.0:1787855915.773525:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787855916.095029:0:12960:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787855916.119918:0:12960:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787855916.119967:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d629 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855916.119984:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d629 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855916.119992:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d629 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855916.119999:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d629 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855916.120019:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787855916.120025:0:12960:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787855916.120047:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787855916.120051:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787855916.120057:0:12960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787855916.120079:0:12960:0:(import.c:65:import_set_state_nolock()) ffff9a73e76bf000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787855916.120115:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874702486293248:0@lo:39:umount.0 00000100:00100000:3.0:1787855916.120182:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855916.120279:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486293248 00000100:00100000:3.0:1787855916.120286:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486293248 00000100:00100000:3.0:1787855916.120329:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787855916.120338:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e748b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874702486293248:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787855916.120364:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d3ac 00000100:00080000:3.0:1787855916.120384:0:5833:0:(import.c:65:import_set_state_nolock()) ffff9a73f9d17000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787855916.120445:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e748b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1874702486293248:12345-0@lo:39:umount.0 Request processed in 107us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855916.120453:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1787855916.120462:0:5833:0:(genops.c:885:class_export_put()) final put ffff9a73f9d17800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1787855916.120976:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73e76bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787855916.120997:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874702486293248:0@lo:39:umount.0 00000100:00080000:3.0:1787855916.121017:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787855916.121020:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787855916.121024:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787855916.122571:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855916.122607:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d629 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.122620:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229e00 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787855916.122624:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d629 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.122634:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x516929ca3366d629 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855916.122642:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x516929ca3366d629 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855916.122648:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787855916.122650:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787855916.122653:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787855916.122692:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d629 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.122699:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787855916.122728:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d629 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.122735:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366d622 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d629 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.122750:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855916.122752:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855916.122754:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787855916.122767:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73f9d17800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787855916.122845:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a73f9d17000 for lustre-MDT0000 00000100:00100000:0.0:1787855916.122939:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486293376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787855916.123014:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855916.123085:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486293376 00000100:00100000:0.0:1787855916.123091:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486293376 00000100:00100000:0.0:1787855916.123139:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787855916.123148:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+19:3306:x1874702486293376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787855916.123160:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855916.123176:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c166dc00/0x516929ca3366d629 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x516929ca3366d622 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.123187:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855916.123222:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:3306:x1874702486293376:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855916.123228:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787855916.123263:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486293376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787855916.127041:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855916.128842:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d637 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.128860:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d637 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.128868:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d637 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.128876:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d637 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.128896:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787855916.128921:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855916.128927:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d637 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.128935:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228c00 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787855916.128939:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d637 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.128947:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x516929ca3366d637 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855916.128954:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x516929ca3366d637 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855916.128960:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787855916.128962:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787855916.129007:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d637 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.129014:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787855916.129035:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d637 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.129041:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366d630 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d637 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.129055:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855916.129057:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855916.129059:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855916.129076:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486293504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787855916.129144:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855916.129218:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486293504 00000100:00100000:0.0:1787855916.129224:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486293504 00000100:00100000:0.0:1787855916.129273:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787855916.129283:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa9dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2adc339-cccb-4166-8f83-87a1e9e399f1+18:3307:x1874702486293504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787855916.129295:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855916.129310:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c166c600/0x516929ca3366d637 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x516929ca3366d630 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.129323:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855916.129359:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa9dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:3307:x1874702486293504:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855916.129367:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787855916.129407:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486293504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787855916.129433:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d550 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.129441:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d550 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.129449:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d550 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.129455:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d550 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.129608:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787855916.129618:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855916.129622:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d550 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.129639:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143e00 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787855916.129642:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d550 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.129649:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x516929ca3366d550 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855916.129655:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x516929ca3366d550 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855916.129659:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787855916.129661:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787855916.129663:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787855916.129684:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d550 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.129691:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787855916.129709:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d550 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.129715:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366d549 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d550 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.129728:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855916.129730:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855916.129732:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855916.129739:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787855916.129749:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9dff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486293632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787855916.129817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855916.129851:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486293632 00000100:00100000:0.0:1787855916.129855:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486293632 00000100:00100000:0.0:1787855916.129880:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787855916.129887:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e08f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+17:3305:x1874702486293632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787855916.129894:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855916.129903:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402046600/0x516929ca3366d550 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x516929ca3366d549 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.129913:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855916.129941:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e08f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:3305:x1874702486293632:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855916.129948:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787855916.129972:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9dff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486293632:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787855916.129994:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d852 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130001:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d852 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130007:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d852 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130013:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d852 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130025:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787855916.130032:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855916.130037:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d852 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130053:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229400 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787855916.130056:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d852 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130063:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x516929ca3366d852 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855916.130069:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x516929ca3366d852 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855916.130074:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787855916.130076:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787855916.130078:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787855916.130092:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d852 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130098:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787855916.130107:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d852 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130113:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366d84b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d852 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130123:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855916.130124:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855916.130126:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855916.130133:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486293760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787855916.130154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855916.130176:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486293760 00000100:00100000:0.0:1787855916.130184:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486293760 00000100:00100000:0.0:1787855916.130206:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787855916.130211:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e0a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2adc339-cccb-4166-8f83-87a1e9e399f1+16:3305:x1874702486293760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787855916.130218:0:7616:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787855916.130226:0:7616:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c5142600/0x516929ca3366d852 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x516929ca3366d84b expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130234:0:7616:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787855916.130257:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e0a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:3305:x1874702486293760:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855916.130263:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787855916.130284:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2adc339-cccb-4166-8f83-87a1e9e399f1:3305:1874702486293760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787855916.130301:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402046a00/0x516929ca3366d2fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d304 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130308:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402046a00/0x516929ca3366d2fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d304 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130314:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402046a00/0x516929ca3366d2fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d304 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130320:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff9a7402046a00/0x516929ca3366d2fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d304 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130331:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787855916.130334:0:12960:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787855916.130337:0:12960:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1787855916.130361:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855916.130365:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402046a00/0x516929ca3366d2fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d304 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130377:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402046a00 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787855916.130380:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402046a00/0x516929ca3366d2fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d304 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130387:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402046a00/0x516929ca3366d2fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x516929ca3366d304 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855916.130393:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402046a00/0x516929ca3366d2fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x516929ca3366d304 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855916.130398:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787855916.130400:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787855916.130402:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787855916.130414:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402046a00/0x516929ca3366d2fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d304 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130419:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787855916.130433:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402046a00/0x516929ca3366d2fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d304 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130439:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402046a00/0x516929ca3366d2fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d304 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855916.130450:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855916.130452:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855916.130454:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855916.130459:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787855916.136676:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486293888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787855916.136758:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855916.137997:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486293888 00000100:00100000:2.0:1787855916.138008:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486293888 00000100:00100000:2.0:1787855916.138066:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787855916.138075:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+15:3307:x1874702486293888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787855916.138090:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855916.138109:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c166ca00/0x516929ca3366d304 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x516929ca3366d2fd expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855916.138130:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855916.138188:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2adc339-cccb-4166-8f83-87a1e9e399f1+14:3307:x1874702486293888:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855916.138197:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:01000004:1.0:1787855916.139829:0:12960:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787855916.139837:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787855916.139843:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787855916.139850:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1787855916.139866:0:12960:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a72c1324800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787855916.139873:0:12960:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a73eb799000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787855916.139879:0:12960:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9a73c5158000) has exports, disconnecting them 00000020:00080000:1.0:1787855916.139883:0:12960:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a72c1324800), last request at 1787855914 00000020:00000080:1.0:1787855916.139891:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d511 00000100:00080000:1.0:1787855916.139908:0:12960:0:(import.c:65:import_set_state_nolock()) ffff9a72c1322000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787855916.139960:0:12960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a72c1324800): rc 0 00000020:00000080:1.0:1787855916.139963:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a72c1324800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787855916.139975:0:12960:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a73eb799000), last request at 1787855914 00000020:00000080:1.0:1787855916.139979:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d446 00000100:00080000:1.0:1787855916.139985:0:12960:0:(import.c:65:import_set_state_nolock()) ffff9a73d22e8000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787855916.139996:0:12960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a73eb799000): rc 0 00000020:00000080:1.0:1787855916.139998:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73eb799000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1787855916.140004:0:12960:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb343822e3ae0 00000100:00080000:1.0:1787855916.140027:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787855916.140031:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1787855916.140046:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787855916.140116:0:12960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787855916.140139:0:12960:0:(import.c:65:import_set_state_nolock()) ffff9a740049b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787855916.140154:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787855916.140157:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787855916.140165:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787855916.140219:0:12960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787855916.140227:0:12960:0:(import.c:65:import_set_state_nolock()) ffff9a73fa3cf000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787855916.140254:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a73c5158000) has no exports 00000020:00000080:1.0:1787855916.140283:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a72c1324800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787855916.140329:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73eb799000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787855916.140352:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a72c1322000 for lustre-MDT0000 00000020:00000080:1.0:1787855916.140364:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a73d22e8000 for lustre-MDT0000 00010000:00010000:1.0:1787855916.140382:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855916.140422:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2adc339-cccb-4166-8f83-87a1e9e399f1:3307:1874702486293888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787855916.140459:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855916.142428:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df848b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486294016:0@lo:9:umount.0 00000100:00100000:3.0:1787855916.142523:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855916.142565:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486294144:0@lo:9:umount.0 00000100:00100000:3.0:1787855916.142600:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855916.142638:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486294016 00000100:00100000:3.0:1787855916.142645:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486294016 00000100:00100000:3.0:1787855916.142697:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486294144 00000100:00100000:3.0:1787855916.142700:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486294144 00000100:00100000:3.0:1787855916.142726:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787855916.142734:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874702486294016:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787855916.142761:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d493 00000100:00080000:3.0:1787855916.142770:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9a740049f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787855916.142844:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787855916.143164:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3303:x1874702486294016:12345-0@lo:9:umount.0 Request processed in 429us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855916.143172:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787855916.143187:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787855916.143204:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7648f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874702486294144:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787855916.143217:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d57a 00000100:00080000:3.0:1787855916.143222:0:6679:0:(import.c:65:import_set_state_nolock()) ffff9a73fa51c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787855916.143241:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787855916.143431:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7648f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3303:x1874702486294144:12345-0@lo:9:umount.0 Request processed in 226us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855916.143438:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787855916.143456:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787855916.143459:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787855916.143491:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a740049b000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787855916.143503:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787855916.143505:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787855916.143508:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df848b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486294016:0@lo:9:umount.0 00000100:00080000:3.0:1787855916.143517:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73fa3cf000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787855916.143524:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787855916.143526:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787855916.143528:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486294144:0@lo:9:umount.0 00010000:00010000:3.0:1787855916.144145:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855916.144151:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787855916.192955:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a73c5158000) has no exports 00000020:00000080:1.0:1787855916.280594:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d358 00000020:00000080:1.0:1787855916.280611:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a7400494800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787855916.280681:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787855916.280877:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787855916.280887:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787855916.280904:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9a73c50e19d0) has no exports 00000020:00000080:2.0:1787855916.281692:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d351 00000020:00000080:2.0:1787855916.281702:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a7400485800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787855916.284220:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a7400494800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787855916.289969:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a7400485800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787855916.290345:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787855916.290358:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787855916.290364:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a7400480800/lustre-QMT0000_UUID 00000020:00000080:2.0:1787855916.290367:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff9a7400480800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787855916.290378:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1787855916.290681:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a73df87fd20 - data ffff9a73d02d1ca8/ffff9a72c3204000 00000020:01000000:2.0:1787855916.291431:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a73dc6600c0 - data ffff9a73ecffd438/ffff9a73f9d3cc00 00000001:00000004:2.0:1787855916.300652:0:12960:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1787855916.406998:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787855916.407008:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787855916.407032:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787855916.407035:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787855916.408944:0:6982:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787855916.408953:0:6982:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1787855916.408966:0:6982:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787855916.411217:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787855916.411226:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787855916.411246:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787855916.411249:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787855916.411473:0:8075:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787855916.411481:0:8075:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1787855916.411491:0:8075:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787855916.490161:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d320 00000020:00000080:2.0:1787855916.490173:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73e76b9800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787855916.490319:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73e76b9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787855916.492898:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d335 00000020:00000080:2.0:1787855916.492911:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73e76c5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787855916.492931:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787855916.492937:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787855916.492946:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787855916.492950:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9a73c515cd70) has no exports 00000020:00000080:0.0:1787855916.493101:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73e76c5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1787855916.493862:0:12960:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787855916.493872:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d573 00000020:00000080:2.0:1787855916.493878:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73fa3cd000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787855916.493894:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787855916.493898:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787855916.493915:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787855916.493918:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9a72c2bd0000) has no exports 00000020:00000080:2.0:1787855916.493925:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d56c 00000020:00000080:2.0:1787855916.493929:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73fa3c9000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787855916.494075:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73fa3cd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787855916.494083:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73fa3c9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787855916.495880:0:12960:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787855916.495888:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787855916.495891:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787855916.495899:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787855916.495901:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787855916.495947:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787855916.495957:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787855916.495965:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d48c 00000020:00000080:2.0:1787855916.495972:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73c50ea800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787855916.495977:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787855916.496583:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a73fa3cf000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787855916.496591:0:8:0:(genops.c:885:class_export_put()) final put ffff9a72c1b20000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787855916.496594:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a72c1b20000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787855916.496600:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787855916.496680:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73c50ea800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787855916.496811:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787855916.496819:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787855916.496823:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9a74004ccd70) has no exports 00000020:00000080:2.0:1787855916.496830:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d485 00000020:00000080:2.0:1787855916.496835:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a740049e800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787855916.497015:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a740049e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787855916.498608:0:12960:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787855916.498614:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787855916.498622:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787855916.498629:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787855916.498631:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787855916.498888:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a740049b000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787855916.499465:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787855916.499478:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787855916.499484:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a72c1bbf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787855916.499487:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff9a72c1bbf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787855916.499494:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787855916.499659:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787855916.499878:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787855916.499882:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73e76b9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787855916.499895:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73e76b9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787855916.499899:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787855916.500010:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d33c 00000020:00000080:2.0:1787855916.500017:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73e76c4800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787855916.500034:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787855916.500038:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787855916.500042:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787855916.500046:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9a73c51599d0) has no exports 00000020:00000080:2.0:1787855916.500068:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787855916.500071:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787855916.500074:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d343 00000020:00000080:2.0:1787855916.500077:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73e76c2000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787855916.500094:0:12960:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a73f4b59000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787855916.500097:0:12960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a73f4b59000 3 00000020:01000004:2.0:1787855916.500099:0:12960:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a73f4b59000 from lustre-MDT0000 00000020:00000080:2.0:1787855916.500119:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787855916.500122:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787855916.500124:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73e76bb800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787855916.500126:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73e76bb800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787855916.500132:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787855916.500157:0:12960:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787855916.500160:0:12960:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787855916.500162:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787855916.500169:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787855916.500172:0:12960:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787855916.500179:0:12960:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9a73c54e6800 b2adc339-cccb-4166-8f83-87a1e9e399f1 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787855916.500185:0:12960:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9a73c515b3a0) has exports, disconnecting them 00000020:00080000:2.0:1787855916.500189:0:12960:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a73c54e6800), last request at 1787855682 00000020:00000080:2.0:1787855916.500203:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d2e1 00000020:00010000:2.0:1787855916.500208:0:12960:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a73c54e6800: total 2 00000020:00000080:0.0:1787855916.500209:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73e76c4800/lustre-MDD0000_UUID for lustre-MDD0000 00000100:00080000:2.0:1787855916.500212:0:12960:0:(import.c:65:import_set_state_nolock()) ffff9a73c54e1000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787855916.500213:0:8:0:(genops.c:885:class_export_put()) final put ffff9a73e76c0800/lustre-MDD0000_UUID 00000020:00000080:0.0:1787855916.500215:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73e76c0800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787855916.500219:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00080000:2.0:1787855916.500230:0:12960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a73c54e6800): rc 0 00000020:00080000:2.0:1787855916.500240:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9a73c515b3a0) has no exports 00000020:00000080:0.0:1787855916.500382:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73e76c2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1787855916.500418:0:5826:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a73d0c8ea00:5826] 0 exiting: rc = 1 00000020:00010000:1.0:1787855916.500493:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a73c54e6800: total 0 00010000:00010000:1.0:1787855916.500522:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a73c54e6800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787855916.500548:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c5143600/0x516929ca3366d844 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x516929ca3366d83d expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855916.500563:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a7402172400/0x516929ca3366d3f9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x516929ca3366d3f2 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855916.500585:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366d836 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x516929ca3366d82f expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855916.500597:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73d1229a00/0x516929ca3366d645 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x516929ca3366d63e expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855916.500605:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c166c800/0x516929ca3366d5ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x516929ca3366d5f8 expref: 5 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855916.500613:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c166d400/0x516929ca3366d5f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x516929ca3366d5ea expref: 4 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855916.500623:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73d1228400/0x516929ca3366d60d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x516929ca3366d606 expref: 3 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855916.500647:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73d1228200/0x516929ca3366d61b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x516929ca3366d614 expref: 2 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855916.500656:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a73c54e6800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787855916.500666:0:5821:0:(genops.c:885:class_export_put()) final put ffff9a73c54e6800/b2adc339-cccb-4166-8f83-87a1e9e399f1 00010000:00010000:1.0:1787855916.500682:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855916.500685:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855916.500686:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787855916.500753:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73c54e6800/b2adc339-cccb-4166-8f83-87a1e9e399f1 for MGS 00000020:00000080:2.0:1787855916.500804:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a73c54e1000 for MGS 00000100:00100000:3.0:1787855916.501276:0:5827:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a73c56e8200:5827] 1 exiting: rc = 0 00000100:00100000:3.0:1787855916.501399:0:5828:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a73c6067400:5828] 2 exiting: rc = 0 00000100:00100000:2.0:1787855916.501489:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501497:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501503:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501507:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501513:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501518:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501523:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501527:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501532:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501538:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501543:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501548:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501554:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501559:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501564:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501579:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501585:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501590:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501595:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501600:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501606:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501611:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501616:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501621:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501625:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501630:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501635:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501641:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501646:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501650:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501655:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501679:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501684:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501690:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501695:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501700:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501705:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501710:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501715:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501720:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501726:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501731:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501737:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501749:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501755:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501760:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501766:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501772:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501797:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501803:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501808:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501813:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501819:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501825:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501830:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501836:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501841:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501847:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501852:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501858:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501864:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501870:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501876:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.501881:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787855916.502515:0:12960:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787855916.502519:0:12960:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1787855916.504690:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a73c83b2720 - data ffff9a73ecfa1ca8/ffff9a72c308f000 00000020:01000000:2.0:1787855916.504909:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a73f486a540 - data ffff9a73ecfaa870/ffff9a73c446bc00 00000020:00000080:2.0:1787855916.505718:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d2c5 00000020:00000080:2.0:1787855916.505727:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73c72ba800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787855916.505747:0:12960:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a73f4b59000 from MGS, refs=2 00000020:01000004:2.0:1787855916.505750:0:12960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a73f4b59000 2 00000020:01000004:2.0:1787855916.505753:0:12960:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a73f4b59000 from MGS 00000020:00000080:2.0:1787855916.505792:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787855916.505798:0:12960:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787855916.505801:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73c72bf000/MGS 00000020:00000080:2.0:1787855916.505804:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73c72bf000/MGS for MGS 00000020:01000000:2.0:1787855916.505810:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1787855916.505810:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73c72ba800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787855916.505863:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787855916.505867:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787855916.505872:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787855916.505878:0:12960:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a73e76ba800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787855916.505884:0:12960:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9a73c50e33a0) has exports, disconnecting them 00000020:00080000:2.0:1787855916.505888:0:12960:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a73e76ba800), last request at 1787855683 00000020:00000080:2.0:1787855916.505893:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d390 00000020:00080000:2.0:1787855916.506040:0:12960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a73e76ba800): rc 0 00000020:00000080:2.0:1787855916.506045:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73e76ba800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787855916.506155:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73e76ba800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787855916.508847:0:12960:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787855916.508855:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787855916.508859:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787855916.508876:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787855916.509029:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a73e76bf000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787855916.509123:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787855916.509131:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787855916.509137:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73e76be000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787855916.509140:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73e76be000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787855916.509149:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787855916.509220:0:12960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a73f4b59000 1 00000020:00000080:0.0:1787855916.509226:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d2b7 00000020:00000080:0.0:1787855916.509234:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73c72b9000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787855916.509249:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787855916.509254:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787855916.509259:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787855916.509265:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9a73c50e0000) has no exports 00000020:00000080:1.0:1787855916.509298:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73c72b9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787855916.573853:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787855916.573869:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787855916.573875:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73f4b5b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787855916.573880:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73f4b5b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787855916.573888:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787855916.574025:0:12960:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a73f4b5a800 00000020:01000000:0.0:1787855916.574049:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787855916.574053:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787855916.574057:0:12960:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787855916.574061:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9a73c44933a0) has no exports 00000100:00100000:3.0:1787855916.576298:0:5835:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a73c6067e00:5835] 2 exiting: rc = 0 00000100:00100000:3.0:1787855916.576404:0:5834:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a73c4499600:5834] 1 exiting: rc = 0 00000100:00100000:3.0:1787855916.576801:0:5833:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a73d0f30600:5833] 0 exiting: rc = 1 00000100:00100000:3.0:1787855916.576874:0:9629:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a72c3367400:9629] 3 exiting: rc = 0 00000100:00100000:0.0:1787855916.578658:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578667:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578673:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578678:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578683:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578688:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578693:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578699:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578704:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578722:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578727:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578732:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578738:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578743:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578749:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578755:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578761:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578767:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578772:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578795:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578802:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578809:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578814:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578820:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578826:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578831:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578837:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578842:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578847:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578852:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578856:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578862:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578880:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578887:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578893:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578899:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578904:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578910:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578917:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578922:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578926:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578931:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578936:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578940:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578955:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578960:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578965:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578971:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578976:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578980:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578986:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578992:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.578997:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.579002:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.579007:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.579012:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.579017:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.579021:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.579026:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.579032:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.579036:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.579040:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.579044:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.579070:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855916.587235:0:12870:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9a74004de800:12870] 2 exiting: rc = 0 00000100:00100000:3.0:1787855916.587544:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a73c453ce00:5836] 0 exiting: rc = 1 00000100:00100000:0.0:1787855916.587978:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a73c454e600:5837] 1 exiting: rc = 0 00000100:00100000:0.0:1787855916.588175:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588184:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588190:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588195:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588202:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588207:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588213:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588218:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588223:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588228:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588232:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588238:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588245:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588251:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588270:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588276:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588281:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588286:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588292:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588297:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588302:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588307:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588313:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588318:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588324:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588329:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588334:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588339:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588343:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588349:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588354:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588359:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588364:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588368:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588373:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588377:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588382:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588388:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588393:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588398:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588403:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588408:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588412:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588417:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588423:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588428:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588433:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588439:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588444:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588468:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588474:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588479:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588484:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588489:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588494:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588499:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588504:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588509:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588514:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588519:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588525:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588530:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588535:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.588540:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855916.589276:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a73c453de00:5838] 0 exiting: rc = 1 00000100:00100000:1.0:1787855916.589351:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a73c453cc00:5839] 1 exiting: rc = 0 00000100:00100000:0.0:1787855916.589438:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589446:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589462:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589469:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589477:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589483:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589490:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589496:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589502:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589507:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589513:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589519:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589542:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589549:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589555:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589560:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589577:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589583:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589589:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589594:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589609:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589615:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589622:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589628:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589648:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589655:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589660:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589667:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589672:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589679:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589685:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589692:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589708:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589716:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589722:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589728:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589748:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589755:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589761:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589767:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589802:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589810:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589816:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589822:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589827:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589833:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589839:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589845:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589865:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589871:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589877:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589883:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589889:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589894:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589900:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589913:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589919:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589925:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589931:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589936:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589958:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589965:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589971:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.589976:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855916.603027:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a73c453c600:5840] 0 exiting: rc = 1 00000100:00100000:3.0:1787855916.605076:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a73c453d000:5841] 1 exiting: rc = 0 00000100:00100000:0.0:1787855916.605762:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605770:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605793:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605798:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605804:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605809:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605813:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605818:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605823:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605831:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605900:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605908:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605913:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605918:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605924:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605929:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605934:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605938:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605944:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605949:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605954:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605959:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605965:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605971:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605976:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605982:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.605999:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606004:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606010:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606016:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606022:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606027:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606033:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606038:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606045:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606051:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606056:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606062:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606068:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606073:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606153:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606161:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606168:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606173:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606179:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606185:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606191:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606196:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606201:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606207:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606212:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606217:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606222:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606227:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606232:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606237:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606242:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606247:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606253:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606258:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606264:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606277:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606283:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.606288:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855916.607014:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a73c454e200:5843] 1 exiting: rc = 0 00000100:00100000:2.0:1787855916.610443:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a73c453c000:5842] 0 exiting: rc = 1 00000100:00100000:0.0:1787855916.612465:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612476:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612482:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612487:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612492:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612497:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612502:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612507:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612512:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612517:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612523:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612529:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612534:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612539:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612544:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612549:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612554:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612560:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612591:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612597:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612602:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612607:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612613:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612617:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612622:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612627:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612631:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612636:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612641:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612645:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612650:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612654:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612672:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612677:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612683:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612688:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612693:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612704:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612709:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612715:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612719:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612725:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612730:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612921:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612929:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612934:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612939:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612944:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612949:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612954:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612959:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612964:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612968:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612973:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612978:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612983:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612988:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612992:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.612997:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.613001:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.613006:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.613011:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.613016:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.613020:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787855916.615844:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a73c454f200:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1787855916.615928:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a73c454f600:5845] 1 exiting: rc = 0 00000100:00100000:0.0:1787855916.615983:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.615990:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.615995:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616014:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616024:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616031:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616036:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616042:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616047:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616052:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616058:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616063:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616068:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616073:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616089:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616095:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616101:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616107:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616112:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616118:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616124:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616129:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616136:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616141:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616145:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616150:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616155:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616160:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616165:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616170:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616175:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616180:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616185:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616190:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616195:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616201:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616206:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616211:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616224:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616230:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616235:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616241:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616246:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616251:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616257:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616262:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616266:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616271:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616276:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616282:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616287:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616292:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616297:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616302:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616308:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616312:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616317:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616322:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616328:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616333:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616338:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616344:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616349:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.616354:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.617335:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a73c4504400:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1787855916.617664:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a73c4504000:5847] 1 exiting: rc = 0 00000100:00100000:0.0:1787855916.617994:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a73c4505800:5848] 2 exiting: rc = 0 00000100:00100000:0.0:1787855916.618051:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618060:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618158:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618167:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618174:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618180:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618197:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618204:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618210:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618217:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618223:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618230:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618235:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618241:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618248:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618256:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618262:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618269:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618275:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618281:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618286:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618292:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618298:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618304:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618309:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618315:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618336:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618344:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618352:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618359:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618365:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618371:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618378:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618827:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618837:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618844:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618850:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618856:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618864:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618870:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618878:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618944:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618952:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618958:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618965:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618971:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618978:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618984:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618990:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.618996:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.619018:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.619025:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.619031:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.619037:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.619042:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.619049:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.619055:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.619061:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.619068:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.619074:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.619837:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.619848:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.619854:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787855916.619862:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787855916.632927:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787855916.632941:0:12960:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787855916.632947:0:12960:0:(genops.c:885:class_export_put()) final put ffff9a73c44a6800/MDS_uuid 00000020:00000080:0.0:1787855916.632951:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73c44a6800/MDS_uuid for MDS 00000020:01000000:0.0:1787855916.632956:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787855916.633076:0:12960:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787855916.829573:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855917.883923:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855918.916749:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787855919.266288:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787855919.266307:0:7628:0:(genops.c:885:class_export_put()) final put ffff9a73fa51d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787855919.266373:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73fa51d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787855919.266417:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a73fa51c000 for lustre-OST0001 00000100:00100000:0.0:1787855919.743614:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787855919.743647:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486294400:0@lo:400:kworker.0 00000400:00000100:0.0:1787855919.743702:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874702486294400 offset 0 length 224: 4 00000100:00100000:0.0:1787855919.743812:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486294528:0@lo:400:kworker.0 00000400:00000100:0.0:1787855919.743851:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874702486294528 offset 0 length 224: 4 00000100:00100000:3.0:1787855919.743944:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787855919.743955:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486294272:0@lo:400:kworker.0 00000400:00000100:3.0:1787855919.743980:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874702486294272 offset 0 length 224: 4 00010000:00010000:1.0:1787855919.947881:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787855920.804438:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787855920.804448:0:6703:0:(genops.c:885:class_export_put()) final put ffff9a740049c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787855920.804512:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a740049c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787855920.804562:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a740049f800 for lustre-OST0000 00010000:00010000:3.0:1787855920.955944:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787855921.757471:0:13112:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787855921.769304:0:13112:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787855921.769353:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d60d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855921.769369:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d60d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855921.769379:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d60d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855921.769387:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d60d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855921.769449:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787855921.769455:0:13112:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787855921.769491:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787855921.769504:0:13112:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a72c2e0b480 x1874702486294400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855935 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855921.769525:0:13112:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787855921.769532:0:13112:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787855921.769557:0:13112:0:(import.c:65:import_set_state_nolock()) ffff9a73d0d07800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787855921.769714:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874702486294656:0@lo:39:umount.0 00000400:00000100:2.0:1787855921.769768:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874702486294656 offset 0 length 224: 4 00000100:00100000:0.0:1787855921.770164:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486294400:0@lo:400:kworker.0 00010000:00010000:1.0:1787855921.770318:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787855921.770327:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d60d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855921.770347:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402047600 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:1.0:1787855921.770352:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d60d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855921.770361:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x516929ca3366d60d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787855921.770369:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x516929ca3366d60d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787855921.770374:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787855921.770377:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787855921.770379:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787855921.770407:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d60d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855921.770413:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787855921.770458:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486294784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787855921.770513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855921.770602:0:7616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486294784 00000100:00100000:0.0:1787855921.770609:0:7616:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486294784 00000100:00100000:0.0:1787855921.770657:0:7616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787855921.770664:0:7616:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f76492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3306:x1874702486294784:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787855921.770670:0:7616:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787855921 with bad export cookie 5866265938049290977 00010000:00010000:1.0:1787855921.774866:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d60d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855921.774887:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402047600/0x516929ca3366d606 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x516929ca3366d60d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855921.774909:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855921.774912:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855921.774914:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855921.783917:0:7616:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f76492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3306:x1874702486294784:12345-0@lo:103:ldlm_bl.0 Request processed in 13245us (13396us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787855921.783933:0:7616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787855921.784213:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.138@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787855921.784219:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a73c44a0800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787855921.784223:0:3306:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1787855921.795167:0:3306:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.138@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787855921.795173:0:3306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787855921.795183:0:3306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a72c2e0a1c0 x1874702486294272/t0(0) o400->MGC192.168.201.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787855935 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855921.795198:0:3306:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a73df84b480 x1874702486294784/t0(0) o103->MGC192.168.201.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787855937 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787855921.795206:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787855921.795209:0:3306:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787855921.795210:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787855921.795213:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9a73c44a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787855921.795218:0:3306:0:(import.c:510:import_select_connection()) MGC192.168.201.138@tcp: connect to NID 0@lo last attempt 173 00000100:00080000:2.0:1787855921.795226:0:3306:0:(import.c:624:import_select_connection()) MGC192.168.201.138@tcp: import ffff9a73c44a0800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:2.0:1787855921.795458:0:3306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73cb674b40 x1874702486294912/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787855921.795516:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486294272:0@lo:400:kworker.0 00000100:00100000:2.0:1787855921.795543:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2adc339-cccb-4166-8f83-87a1e9e399f1:3306:1874702486294784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787855921.795681:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb674b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b2adc339-cccb-4166-8f83-87a1e9e399f1:3303:1874702486294912:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1787855921.795729:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874702486294912 offset 0 length 520: 4 00010000:00010000:3.0:1787855921.982106:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855923.004589:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855924.030805:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787855924.860159:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b2adc339-cccb-4166-8f83-87a1e9e399f1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787855924.860169:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) b2adc339-cccb-4166-8f83-87a1e9e399f1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787855924.866264:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486295040:0@lo:400:kworker.0 00000400:00000100:2.0:1787855924.866337:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874702486295040 offset 0 length 224: 4 00010000:00010000:1.0:1787855925.052017:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855926.076146:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787855926.910317:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b2adc339-cccb-4166-8f83-87a1e9e399f1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787855926.910327:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) b2adc339-cccb-4166-8f83-87a1e9e399f1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787855926.912248:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486295168:0@lo:400:kworker.0 00000400:00000100:0.0:1787855926.912307:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874702486295168 offset 0 length 224: 4 00010000:00010000:1.0:1787855927.100067:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855928.128446:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855929.147931:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855930.172082:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855931.004655:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787855921/real 1787855921] req@ffff9a73cb674b40 x1874702486294912/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787855931 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855931.004685:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a73cb674b40 x1874702486294912/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787855931 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855931.004717:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787855921/real 1787855921] req@ffff9a73f7648000 x1874702486294656/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787855931 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855931.004732:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a73f7648000 x1874702486294656/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787855931 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787855931.004763:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73c44a0800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787855931.004824:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787855931.004828:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb674b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b2adc339-cccb-4166-8f83-87a1e9e399f1:3303:1874702486294912:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1787855931.004836:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73d0d07800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787855931.004847:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874702486294656:0@lo:39:umount.0 00000100:00080000:3.0:1787855931.005044:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787855931.005049:0:13112:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787855931.005054:0:13112:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787855931.006229:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d61b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855931.006245:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d61b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855931.006253:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d61b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855931.006261:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d61b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855931.006280:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787855931.006287:0:13112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d844 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855931.006294:0:13112:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d844 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855931.006301:0:13112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d844 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855931.006332:0:13112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d844 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855931.006349:0:13112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787855931.006354:0:13112:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787855931.006379:0:13112:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787855931.006383:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787855931.006388:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787855931.006394:0:13112:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787855931.006399:0:13112:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9a73c4490000) has no exports 00000020:00080000:3.0:1787855931.006422:0:13112:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9a73c4490000) has no exports 00010000:00010000:0.0:1787855931.008438:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787855931.008451:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d61b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855931.008464:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229800 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787855931.008468:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d61b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855931.008478:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x516929ca3366d61b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855931.008486:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x516929ca3366d61b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855931.008510:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787855931.008514:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787855931.008518:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787855931.008537:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a73c44a0800 00010000:00010000:0.0:1787855931.008541:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x516929ca3366d61b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855931.008549:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73d1229800/0x516929ca3366d614 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x516929ca3366d61b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855931.008567:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855931.008571:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d844 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855931.008578:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402047a00 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787855931.008581:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d844 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855931.008588:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x516929ca3366d844 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855931.008595:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x516929ca3366d844 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855931.008600:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787855931.008602:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787855931.008604:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787855931.008609:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a73c44a0800 00010000:00010000:0.0:1787855931.008612:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x516929ca3366d844 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855931.008624:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402047a00/0x516929ca3366d83d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x516929ca3366d844 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855931.008634:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855931.008636:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855931.008637:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787855931.008817:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b2adc339-cccb-4166-8f83-87a1e9e399f1->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787855931.008823:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787855931.008826:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a73c44a0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787855931.008834:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.138@tcp: connect to NID 0@lo last attempt 412 00000100:00080000:1.0:1787855931.008839:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.138@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787855931.008845:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.138@tcp: import ffff9a73c44a0800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1787855931.008876:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73df848f00 x1874702486295296/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787855931.008955:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df848780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486295424:0@lo:400:kworker.0 00000400:00000100:1.0:1787855931.009005:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874702486295424 offset 0 length 224: 4 00010000:00010000:1.0:1787855931.009081:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787855931.009181:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df848f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b2adc339-cccb-4166-8f83-87a1e9e399f1:3303:1874702486295296:0@lo:250:kworker.0 00000400:00000100:0.0:1787855931.009206:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874702486295296 offset 0 length 520: 4 00000020:01000000:3.0:1787855931.013046:0:13112:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a73df87f780 - data ffff9a73d0015af8/ffff9a72c3204c00 00000020:01000000:3.0:1787855931.013209:0:13112:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a74006d5000 - data ffff9a73d007d360/ffff9a72c10f0400 00100000:10000000:3.0:1787855931.019472:0:13112:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787855931.072333:0:13112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d415 00000020:00000080:0.0:1787855931.072345:0:13112:0:(genops.c:885:class_export_put()) final put ffff9a73d22e8800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787855931.072367:0:13112:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a73d0d01000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787855931.072370:0:13112:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a73d0d01000 2 00000020:01000004:0.0:1787855931.072373:0:13112:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a73d0d01000 from lustre-OST0000 00000020:00000080:0.0:1787855931.072393:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787855931.072403:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787855931.072406:0:13112:0:(genops.c:885:class_export_put()) final put ffff9a73d22ee000/lustre-OST0000_UUID 00000020:00000080:0.0:1787855931.072409:0:13112:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73d22ee000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787855931.072425:0:13112:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787855931.072464:0:13112:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787855931.072468:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787855931.072471:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787855931.072476:0:13112:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787855931.072482:0:13112:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a73e762b800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787855931.072487:0:13112:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9a73d06e4d70) has exports, disconnecting them 00000020:00080000:0.0:1787855931.072491:0:13112:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a73e762b800), last request at 1787855698 00000020:00000080:0.0:1787855931.072495:0:13112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d43f 00000020:00080000:0.0:1787855931.072504:0:13112:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a73e762b800): rc 0 00000020:00000080:0.0:1787855931.072523:0:13112:0:(genops.c:885:class_export_put()) final put ffff9a73e762b800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787855931.073626:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73d22e8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787855931.073645:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73e762b800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787855931.075500:0:13112:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787855931.075507:0:13112:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787855931.075512:0:13112:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787855931.075517:0:13112:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787855931.075719:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787855931.075727:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787855931.075735:0:13112:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a73d0d01000 1 00000020:00000080:2.0:1787855931.075754:0:13112:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d3cf 00000020:00000080:2.0:1787855931.075762:0:13112:0:(genops.c:885:class_export_put()) final put ffff9a73c44a5800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787855931.075767:0:13112:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787855931.075773:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787855931.075794:0:13112:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787855931.075798:0:13112:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9a73d06e33a0) has no exports 00000020:00000080:3.0:1787855931.076304:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a73d0d07800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787855931.076312:0:36:0:(genops.c:885:class_export_put()) final put ffff9a73e7416800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787855931.076325:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73e7416800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787855931.076335:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787855931.076392:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73c44a5800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787855931.112979:0:13112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787855931.112996:0:13112:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787855931.113001:0:13112:0:(genops.c:885:class_export_put()) final put ffff9a73d0d00000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787855931.113006:0:13112:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73d0d00000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787855931.113030:0:13112:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787855931.113176:0:13112:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a73d0d07000 00000020:02000400:2.0:1787855931.113223:0:13112:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787855931.317154:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855932.347913:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855933.372999:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787855933.636209:0:13263:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787855933.649964:0:13263:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787855933.650048:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d5f1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855933.650062:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d5f1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855933.650070:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d5f1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855933.650077:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d5f1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855933.650125:0:13263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787855933.650132:0:13263:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787855933.650154:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787855933.650165:0:13263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a72c2e08780 x1874702486294528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855935 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855933.650189:0:13263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a72c2e0b480 x1874702486295040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855940 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787855933.650246:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855933.650253:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d5f1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855933.650259:0:13263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a73f764b840 x1874702486295168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855942 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787855933.650260:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228000 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:2.0:1787855933.650264:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d5f1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855933.650290:0:13263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a73df848780 x1874702486295424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855947 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787855933.650296:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x516929ca3366d5f1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855933.650298:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 10000000:00010000:2.0:1787855933.650303:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x516929ca3366d5f1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855933.650309:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787855933.650311:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787855933.650314:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787855933.650326:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a73c44a0800 00000100:00100000:1.0:1787855933.650326:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486295168:0@lo:400:kworker.0 00010000:00010000:2.0:1787855933.650330:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x516929ca3366d5f1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855933.650336:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73d1228000/0x516929ca3366d5ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x516929ca3366d5f1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855933.650345:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855933.650346:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855933.650348:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787855933.650351:0:13263:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787855933.650383:0:13263:0:(import.c:65:import_set_state_nolock()) ffff9a72c1b22000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787855933.650559:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df848780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486295424:0@lo:400:kworker.0 00000100:00100000:3.0:1787855933.650568:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486294528:0@lo:400:kworker.0 00000100:00100000:0.0:1787855933.650670:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486295040:0@lo:400:kworker.0 00000100:00100000:2.0:1787855933.650816:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df849a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874702486295552:0@lo:39:umount.0 00000400:00000100:2.0:1787855933.650865:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874702486295552 offset 0 length 224: 4 00010000:00010000:3.0:1787855934.398357:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855935.420092:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787855936.125201:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b2adc339-cccb-4166-8f83-87a1e9e399f1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787855936.125212:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) b2adc339-cccb-4166-8f83-87a1e9e399f1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787855936.444042:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855937.468038:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855938.492767:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855939.516085:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855940.541209:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787855941.245024:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b2adc339-cccb-4166-8f83-87a1e9e399f1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787855941.245035:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) b2adc339-cccb-4166-8f83-87a1e9e399f1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787855941.564075:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855942.589904:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855943.612588:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855943.867927:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787855933/real 1787855933] req@ffff9a73df849a40 x1874702486295552/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787855943 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855943.867960:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a73df849a40 x1874702486295552/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787855943 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787855943.867979:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a72c1b22000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787855943.868002:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df849a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874702486295552:0@lo:39:umount.0 00000100:00080000:1.0:1787855943.868211:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787855943.868217:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787855943.868223:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787855943.872280:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d5ff expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855943.872300:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d5ff expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855943.872325:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d5ff expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855943.872331:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d5ff expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855943.872620:0:13263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787855943.872631:0:13263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366d836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855943.872640:0:13263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366d836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855943.872646:0:13263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855943.872652:0:13263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x516929ca3366d836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855943.879816:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787855943.879831:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d5ff expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855943.879843:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166c400 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:3.0:1787855943.879847:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d5ff expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855943.879856:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x516929ca3366d5ff expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787855943.879863:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x516929ca3366d5ff expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855943.879868:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787855943.879871:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1787855943.879886:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a73c44a0800 00010000:00010000:3.0:1787855943.879890:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x516929ca3366d5ff expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855943.879897:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c166c400/0x516929ca3366d5f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x516929ca3366d5ff expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855943.879917:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787855943.879921:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855943.879951:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143000 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:3.0:1787855943.879954:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x516929ca3366d836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855943.879962:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x516929ca3366d836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787855943.879968:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x516929ca3366d836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855943.879973:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787855943.879975:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1787855943.879979:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a73c44a0800 00010000:00010000:3.0:1787855943.879982:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x516929ca3366d836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855943.879989:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855943.879991:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855943.879994:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855943.882288:0:13263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787855943.882304:0:13263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c5143000/0x516929ca3366d82f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x516929ca3366d836 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787855943.882329:0:13263:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1787855943.882337:0:13263:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1787855943.882340:0:13263:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787855943.882369:0:13263:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787855943.882374:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787855943.882397:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787855943.882416:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787855943.882420:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9a72c2bd33a0) has no exports 00000020:00080000:1.0:1787855943.882447:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9a72c2bd33a0) has no exports 00010000:00010000:2.0:1787855943.888405:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787855943.895524:0:13263:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a73c81c7480 - data ffff9a73d0105870/ffff9a73fa2d3400 00000020:01000000:2.0:1787855943.898911:0:13263:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a73fa6365a0 - data ffff9a73d00156c0/ffff9a72c3206800 00100000:10000000:2.0:1787855943.916571:0:13263:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787855943.943563:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d4e0 00000020:00000080:0.0:1787855943.943573:0:13263:0:(genops.c:885:class_export_put()) final put ffff9a73d22ef800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787855943.943592:0:13263:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a73e762a800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787855943.943596:0:13263:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a73e762a800 2 00000020:01000004:0.0:1787855943.943599:0:13263:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a73e762a800 from lustre-OST0001 00000020:00000080:0.0:1787855943.943622:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787855943.943632:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787855943.943635:0:13263:0:(genops.c:885:class_export_put()) final put ffff9a72c1bbf800/lustre-OST0001_UUID 00000020:00000080:0.0:1787855943.943638:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff9a72c1bbf800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787855943.943644:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787855943.943819:0:13263:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import b2adc339-cccb-4166-8f83-87a1e9e399f1->MGS 00010000:00010000:0.0:1787855943.943838:0:13263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a7402172000/0x516929ca3366d3f2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x516929ca3366d3f9 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855943.943849:0:13263:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a7402172000/0x516929ca3366d3f2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x516929ca3366d3f9 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855943.943855:0:13263:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787855943.943858:0:13263:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787855943.943861:0:13263:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787855943.943875:0:13263:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a73c44a0800 00010000:00010000:0.0:1787855943.943879:0:13263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a7402172000/0x516929ca3366d3f2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x516929ca3366d3f9 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855943.943893:0:13263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c5142000/0x516929ca3366d63e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x516929ca3366d645 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787855943.943899:0:13263:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5142000/0x516929ca3366d63e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x516929ca3366d645 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855943.943915:0:13263:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787855943.943917:0:13263:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787855943.943919:0:13263:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787855943.943929:0:13263:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a73c44a0800 00010000:00010000:0.0:1787855943.943932:0:13263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c5142000/0x516929ca3366d63e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x516929ca3366d645 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787855943.943947:0:13263:0:(import.c:65:import_set_state_nolock()) ffff9a73c44a0800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787855943.943952:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787855943.943954:0:13263:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787855943.943956:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787855943.943960:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787855943.943971:0:13263:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a73df848f00 x1874702486295296/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787855946 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787855943.943987:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787855943.943990:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:3.0:1787855943.944240:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df848f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b2adc339-cccb-4166-8f83-87a1e9e399f1:3303:1874702486295296:0@lo:250:kworker.0 10000000:01000000:0.0:1787855943.944463:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787855943.944472:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d2d3 00000020:00000080:0.0:1787855943.944477:0:13263:0:(genops.c:885:class_export_put()) final put ffff9a73c44a2800/b2adc339-cccb-4166-8f83-87a1e9e399f1 00000020:01000000:0.0:1787855943.944484:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.138@tcp (flags='') 00000020:00000080:0.0:1787855943.944490:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787855943.944495:0:13263:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.138@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787855943.944498:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9a73c44919d0) has no exports 00000020:00000080:1.0:1787855943.944605:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73d22ef800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787855943.944619:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73c44a2800/b2adc339-cccb-4166-8f83-87a1e9e399f1 for MGC192.168.201.138@tcp 10000000:01000000:3.0:1787855943.944690:0:5830:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787855943.944771:0:13263:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.138@tcp: client import never connected 00000100:00080000:0.0:1787855943.944870:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787855943.944872:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787855943.944874:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787855943.944876:0:13263:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787855943.944916:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787855943.944921:0:13263:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.138@tcp (uuid b2adc339-cccb-4166-8f83-87a1e9e399f1) 00000020:01000000:0.0:1787855943.944926:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787855943.944937:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787855943.944940:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787855943.944945:0:13263:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a72c1b24800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787855943.944950:0:13263:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9a72c2bd4d70) has exports, disconnecting them 00000020:00080000:0.0:1787855943.944954:0:13263:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a72c1b24800), last request at 1787855716 00000020:00000080:0.0:1787855943.944958:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d50a 00000020:00080000:0.0:1787855943.944967:0:13263:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a72c1b24800): rc 0 00000020:00000080:0.0:1787855943.944970:0:13263:0:(genops.c:885:class_export_put()) final put ffff9a72c1b24800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787855943.945122:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a73c44a0800 for MGC192.168.201.138@tcp 00000020:00000080:1.0:1787855943.945129:0:8:0:(genops.c:885:class_export_put()) final put ffff9a73c72ba000/b2adc339-cccb-4166-8f83-87a1e9e399f1 00000020:00000080:1.0:1787855943.945131:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73c72ba000/b2adc339-cccb-4166-8f83-87a1e9e399f1 for MGC192.168.201.138@tcp 00000020:01000000:1.0:1787855943.945135:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.138@tcp (b2adc339-cccb-4166-8f83-87a1e9e399f1) 00000020:00000080:1.0:1787855943.945683:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a72c1b24800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1787855943.947138:0:13263:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787855943.947145:0:13263:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787855943.947149:0:13263:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787855943.947156:0:13263:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787855943.947364:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a72c1b22000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1787855943.947380:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1787855943.947560:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1787855943.947868:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a73c53eda00:5817] 1 exiting: rc = 0 00000100:00100000:3.0:1787855943.948866:0:7617:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9a72c1cb5800:7617] 2 exiting: rc = 0 00000100:00100000:0.0:1787855943.955974:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a73d0fb0c00:5816] 0 exiting: rc = 1 00000100:00100000:1.0:1787855943.956605:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.957140:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a73c53ec000:5819] 1 exiting: rc = 0 00000100:00100000:0.0:1787855943.960130:0:7616:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a73c7b64800:7616] 3 exiting: rc = 0 00000100:00100000:3.0:1787855943.964279:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a73c53ed000:5818] 0 exiting: rc = 1 00000100:00100000:3.0:1787855943.965861:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a73d0c8e000:5820] 2 exiting: rc = 0 00000100:00100000:1.0:1787855943.966025:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966044:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966050:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966056:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966061:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966067:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966074:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966079:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966083:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966088:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966104:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966110:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966115:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966122:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966128:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966134:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966151:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966156:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966174:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966180:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966185:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966201:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966207:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966212:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966217:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966223:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966228:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966234:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966238:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966243:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966248:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966253:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966258:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966263:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966268:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966273:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966278:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966283:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966288:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966293:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966297:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966302:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966306:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966312:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966316:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966321:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966325:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966331:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966336:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966341:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966346:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966359:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966363:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966368:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966374:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966379:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966673:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966679:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966684:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966690:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966695:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966701:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966706:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855943.966712:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787855943.968755:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787855943.968768:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787855943.968788:0:13263:0:(genops.c:885:class_export_put()) final put ffff9a72c1b27000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787855943.968793:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff9a72c1b27000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787855943.968803:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1787855943.968846:0:13263:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a73e762a800 1 00000020:00000080:1.0:1787855943.968851:0:13263:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x516929ca3366d4af 00000020:00000080:1.0:1787855943.968858:0:13263:0:(genops.c:885:class_export_put()) final put ffff9a73fa51f000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787855943.968870:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787855943.968874:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787855943.968879:0:13263:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787855943.968883:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9a73c50e4d70) has no exports 00000020:00000080:3.0:1787855943.969472:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73fa51f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787855943.990769:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787855943.990809:0:13263:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787855943.990815:0:13263:0:(genops.c:885:class_export_put()) final put ffff9a73e762e800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787855943.990820:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73e762e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787855943.990827:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787855943.991023:0:13263:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a73e7629800 00000020:01000000:3.0:1787855943.991185:0:13263:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787855943.991197:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787855943.991202:0:13263:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787855943.991205:0:13263:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9a73c4494d70) has no exports 00000020:00000080:3.0:1787855943.991229:0:13263:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787855943.991234:0:13263:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787855943.991237:0:13263:0:(genops.c:885:class_export_put()) final put ffff9a73c44a4800/OSS_uuid 00000020:00000080:3.0:1787855943.991239:0:13263:0:(genops.c:844:class_export_destroy()) destroying export ffff9a73c44a4800/OSS_uuid for OSS 00000020:01000000:3.0:1787855943.991242:0:13263:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1787855943.991268:0:5829:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787855943.991552:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a73c9337400:6681] 2 exiting: rc = 0 00000100:00100000:3.0:1787855943.991607:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a73c9337200:6680] 1 exiting: rc = 0 00000100:00100000:3.0:1787855943.991650:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a73d1341400:6679] 0 exiting: rc = 1 00000100:00100000:0.0:1787855943.995603:0:8077:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a73c7a18c00:8077] 3 exiting: rc = 0 00000100:00100000:3.0:1787855943.997385:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997396:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997402:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997410:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997415:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997421:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997426:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997432:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997438:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997443:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997449:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997454:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997477:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997482:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997488:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997494:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997498:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997503:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997508:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997513:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997518:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997523:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997529:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997535:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997541:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997546:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997551:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997556:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997561:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997566:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997572:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997577:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997582:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997587:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997592:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997598:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997602:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997607:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997612:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997618:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997623:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997628:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997633:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997637:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997642:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997647:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997651:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997664:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997669:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997674:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997679:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997684:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997689:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997694:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997699:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997704:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997709:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997714:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997719:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997724:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997729:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997733:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997738:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.997743:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855943.998624:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a73d1341000:6683] 1 exiting: rc = 0 00000100:00100000:2.0:1787855943.999076:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a73d1340400:6682] 0 exiting: rc = 1 00000100:00100000:0.0:1787855943.999679:0:12311:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9a73d811d400:12311] 2 exiting: rc = 0 00000100:00100000:1.0:1787855944.000157:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000167:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000172:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000177:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000182:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000298:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000308:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000313:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000319:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000340:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000346:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000352:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000357:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000362:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000368:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000373:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000378:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000383:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000462:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000469:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000474:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000479:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000485:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000492:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000497:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000502:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000506:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000511:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000516:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000521:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000526:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000531:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000535:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000540:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000545:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000550:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000554:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000558:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000563:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000568:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000572:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000578:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000583:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000588:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000601:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000606:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000611:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000616:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000622:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000627:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000632:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000637:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000643:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000647:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000652:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000657:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000661:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000667:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000673:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000678:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000684:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000688:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000692:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.000697:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855944.004437:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a73dfa4bc00:6686] 2 exiting: rc = 0 00000100:00100000:1.0:1787855944.004840:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a73dfa4aa00:6685] 1 exiting: rc = 0 00000100:00100000:2.0:1787855944.005521:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a73dfa49000:6684] 0 exiting: rc = 1 00000100:00100000:1.0:1787855944.005665:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005673:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005678:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005684:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005688:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005693:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005699:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005704:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005709:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005714:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005720:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005735:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005742:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005747:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005767:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005772:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005801:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005808:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005813:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005819:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005824:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005829:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005834:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005840:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005846:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005851:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005856:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005862:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005867:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005872:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005877:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005882:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005887:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.005892:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006141:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006165:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006172:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006177:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006182:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006196:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006202:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006209:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006214:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006220:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006226:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006232:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006237:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006243:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006249:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006262:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006268:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006274:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006280:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006285:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006291:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006296:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006303:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006308:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006314:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006330:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006340:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006345:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006351:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.006356:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787855944.014468:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a73c605b000:6687] 0 exiting: rc = 1 00000100:00100000:0.0:1787855944.014727:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a73fa853e00:6688] 1 exiting: rc = 0 00000100:00100000:1.0:1787855944.014901:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014910:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014915:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014921:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014925:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014931:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014936:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014942:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014948:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014953:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014958:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014964:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014969:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014974:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014979:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014984:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014989:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.014994:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015001:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015005:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015022:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015026:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015044:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015049:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015055:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015059:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015065:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015072:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015077:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015082:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015087:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015102:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015108:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015113:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015117:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015122:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015126:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015130:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015135:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015141:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015148:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015153:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015158:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015164:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015169:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015174:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015180:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015185:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015200:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015206:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015211:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015217:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015222:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015227:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015232:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015245:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015250:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015255:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015261:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015266:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015271:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015277:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015282:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.015288:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.016339:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a73fa852200:6690] 1 exiting: rc = 0 00000100:00100000:1.0:1787855944.017260:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a73dfa48800:6689] 0 exiting: rc = 1 00000100:00100000:1.0:1787855944.017338:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017346:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017352:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017358:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017363:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017369:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017383:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017523:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017531:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017537:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017543:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017550:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017556:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017563:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017569:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017575:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017584:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017592:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017614:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017622:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017628:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017635:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017651:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017660:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017687:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017695:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017701:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017708:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017714:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017723:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017730:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017736:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017742:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017762:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017770:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017796:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017803:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017809:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017816:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017823:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017830:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017836:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017843:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017849:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017858:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017879:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017887:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017893:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017899:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017906:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017912:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017919:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017926:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017931:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017937:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017943:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017950:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017972:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017979:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017994:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.017999:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.018005:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.018011:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787855944.018025:0:13263:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787855944.028952:0:13263:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787855962.347707:0:13881:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787855972.156203:0:14342:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787855972.156210:0:14342:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787855972.156323:0:14342:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a73f9d8a000 00000020:01000004:2.0:1787855972.156337:0:14342:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787855972.156345:0:14342:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787855972.156360:0:14342:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a74004ccd70) 00000020:00000080:2.0:1787855972.156373:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787855972.170141:0:14342:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787855972.172009:0:14342:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1787855972.172338:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1787855972.172471:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1787855972.172667:0:14342:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787855972.172736:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:0.0:1787855972.173139:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1787855972.173281:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1787855972.173374:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:0.0:1787855972.173992:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:0.0:1787855972.175428:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 592: rc = 0 00100000:10000000:0.0:1787855972.175519:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 592: rc = 0 00100000:10000000:0.0:1787855972.176265:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 601: rc = 0 00100000:10000000:0.0:1787855972.176682:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 601: rc = 0 00100000:10000000:0.0:1787855972.177080:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 601: rc = 0 00100000:10000000:0.0:1787855972.177326:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 601: rc = 0 00100000:10000000:0.0:1787855972.177642:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 601: rc = 0 00100000:10000000:0.0:1787855972.177969:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 601: rc = 0 00100000:10000000:0.0:1787855972.178208:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 601: rc = 0 00100000:10000000:0.0:1787855972.178488:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 601: rc = 0 00100000:10000000:0.0:1787855972.178965:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 601: rc = 0 00100000:10000000:0.0:1787855972.179207:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 601: rc = 0 00100000:10000000:0.0:1787855972.179451:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 601: rc = 0 00100000:10000000:0.0:1787855972.179697:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 601: rc = 0 00100000:10000000:0.0:1787855972.180182:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 229: rc = 0 00100000:10000000:0.0:1787855972.180440:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 229: rc = 0 00100000:10000000:0.0:1787855972.180689:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 229: rc = 0 00100000:10000000:0.0:1787855972.181015:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 229: rc = 0 00100000:10000000:0.0:1787855972.181224:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 229: rc = 0 00100000:10000000:0.0:1787855972.181441:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 229: rc = 0 00100000:10000000:0.0:1787855972.181668:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 229: rc = 0 00100000:10000000:0.0:1787855972.181987:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 229: rc = 0 00100000:10000000:0.0:1787855972.182229:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 229: rc = 0 00100000:10000000:0.0:1787855972.182470:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 229: rc = 0 00100000:10000000:0.0:1787855972.183520:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 229: rc = 0 00100000:10000000:0.0:1787855972.184249:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 229: rc = 0 00100000:10000000:0.0:1787855972.184501:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 229: rc = 0 00100000:10000000:0.0:1787855972.185059:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 229: rc = 0 00100000:10000000:0.0:1787855972.185299:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 229: rc = 0 00100000:10000000:0.0:1787855972.185528:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 229: rc = 0 00100000:10000000:0.0:1787855972.186144:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 229: rc = 0 00100000:10000000:0.0:1787855972.186398:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 229: rc = 0 00100000:10000000:0.0:1787855972.186975:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 229: rc = 0 00100000:10000000:0.0:1787855972.187210:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 229: rc = 0 00100000:10000000:0.0:1787855972.187443:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 229: rc = 0 00100000:10000000:0.0:1787855972.188112:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 229: rc = 0 00100000:10000000:0.0:1787855972.188359:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 229: rc = 0 00100000:10000000:0.0:1787855972.188728:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 229: rc = 0 00100000:10000000:0.0:1787855972.189004:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 229: rc = 0 00100000:10000000:0.0:1787855972.189276:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 229: rc = 0 00100000:10000000:0.0:1787855972.189526:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 229: rc = 0 00100000:10000000:0.0:1787855972.189819:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 229: rc = 0 00100000:10000000:0.0:1787855972.190052:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 229: rc = 0 00100000:10000000:0.0:1787855972.190277:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 229: rc = 0 00100000:10000000:0.0:1787855972.190500:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 229: rc = 0 00100000:10000000:0.0:1787855972.190903:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 229: rc = 0 00100000:10000000:0.0:1787855972.191262:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 218: rc = 0 00100000:10000000:0.0:1787855972.191771:0:14342:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1787855972.192138:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 593: rc = 0 00100000:10000000:0.0:1787855972.192327:0:14342:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1787855972.192390:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 593: rc = 0 00100000:10000000:0.0:1787855972.192571:0:14342:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1787855972.192680:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 593: rc = 0 00100000:10000000:0.0:1787855972.193044:0:14342:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1787855972.193107:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 597: rc = 0 00100000:10000000:0.0:1787855972.193279:0:14342:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1787855972.193346:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 597: rc = 0 00100000:10000000:0.0:1787855972.193533:0:14342:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1787855972.193593:0:14342:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 597: rc = 0 00000020:00000080:0.0:1787855972.194225:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787855972.194232:0:14342:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787855972.194243:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x516929ca3366e5d4 00000020:01000004:0.0:1787855972.194251:0:14342:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787855972.194256:0:14342:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787855972.194261:0:14342:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a73f9d8a000 from MGS 00000020:01000004:0.0:1787855972.194265:0:14342:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787855972.194274:0:14342:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a73c50e0000) 00000020:00000080:0.0:1787855972.194283:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787855972.194337:0:14342:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a73f9d8a000 from MGS, refs=2 00080000:01000000:0.0:1787855972.194341:0:14342:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787855972.194346:0:14342:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x516929ca3366e5e2 00000100:00100000:0.0:1787855972.194442:0:14342:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787855972.194578:0:14342:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787855972.194584:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787855972.196032:0:14342:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787855972.196043:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787855972.197126:0:14342:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787855972.197297:0:14342:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787855972.197303:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787855972.197807:0:14342:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787855972.197817:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787855972.198140:0:14342:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787855972.198146:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787855972.198915:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855972.198918:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855972.198920:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855972.199181:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855972.199183:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855972.199185:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855972.200205:0:14342:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787855972.204225:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787855972.211348:0:14342:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787855972.211367:0:14342:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787855972.211370:0:14342:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787855972.220007:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787855972.220752:0:14342:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787855972.222075:0:14342:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787855972.222576:0:14342:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787855972.230028:0:14342:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787855972.230196:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787855972.230201:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787855972.230729:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787855972.230737:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787855972.232295:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787855972.232307:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787855972.241468:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787855972.241493:0:14342:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.138@tcp' 00000020:01000004:1.0:1787855972.241495:0:14342:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787855972.241527:0:14342:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.138@tcp (typ=mgc) 00000020:00000080:1.0:1787855972.241541:0:14342:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.138@tcp (ffff9a72c2bd4d70) 00000020:00000080:1.0:1787855972.241554:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787855972.241644:0:14342:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a73e76be800@MGC192.168.201.138@tcp: add connection 192.168.201.138@tcp at head 00010000:00010000:1.0:1787855972.241843:0:14342:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.138@tcp-0 is initialized 00000040:01000000:1.0:1787855972.241850:0:14342:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787855972.242163:0:14356:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787855972.246273:0:14357:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787855972.246522:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.138@tcp (uuid ff37be87-90a7-463b-b734-d2f25b77f044) 00000020:00000080:1.0:1787855972.246546:0:14342:0:(genops.c:1385:class_connect()) connect: client ff37be87-90a7-463b-b734-d2f25b77f044, cookie 0x516929ca3366e5f0 00000100:00080000:1.0:1787855972.246559:0:14342:0:(import.c:510:import_select_connection()) MGC192.168.201.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787855972.246566:0:14342:0:(import.c:624:import_select_connection()) MGC192.168.201.138@tcp: import ffff9a73e76be800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1787855972.246617:0:14342:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73df849680 x1874702486295680/t0(0) o250->MGC192.168.201.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787855972.246648:0:14342:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ff37be87-90a7-463b-b734-d2f25b77f044->MGS 00000020:01000004:1.0:1787855972.246669:0:14342:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787855972.246674:0:14342:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787855972.246696:0:14342:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a72c2bd19d0) 00000020:00000080:1.0:1787855972.246709:0:14342:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787855972.248209:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df849680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ff37be87-90a7-463b-b734-d2f25b77f044:3303:1874702486295680:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787855972.248284:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855972.248448:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486295680 00000100:00100000:2.0:1787855972.248456:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486295680 00000100:00100000:2.0:1787855972.248493:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787855972.248501:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1874702486295680:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787855972.248526:0:14353:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from ff37be87-90a7-463b-b734-d2f25b77f044@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:2.0:1787855972.248552:0:14353:0:(genops.c:1385:class_connect()) connect: client ff37be87-90a7-463b-b734-d2f25b77f044, cookie 0x516929ca3366e5fe 00000100:00080000:2.0:1787855972.248687:0:14353:0:(import.c:65:import_set_state_nolock()) ffff9a73c54e2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787855972.248744:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+5:3303:x1874702486295680:12345-0@lo:250:mount.lustre.0 Request processed in 243us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855972.248753:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787855972.248825:0:3303:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787855972.248834:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.138@tcp: connect to target with instance 0 00000100:00080000:2.0:1787855972.248842:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787855972.248846:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787855972.248849:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73e76be800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787855972.248852:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787855972.248863:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787855972.248867:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df849680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ff37be87-90a7-463b-b734-d2f25b77f044:3303:1874702486295680:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787855972.282367:0:14342:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787855972.282571:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787855972.282577:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787855972.284013:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787855972.284024:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787855972.292379:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787855972.292392:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787855972.293219:0:14342:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787855972.293414:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787855972.293420:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787855972.294218:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787855972.294226:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787855972.344516:0:14342:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787855972.344794:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787855972.344811:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787855972.346630:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787855972.346646:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787855972.347466:0:14342:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787855972.347667:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787855972.347672:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787855972.348303:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787855972.348312:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787855972.348829:0:14342:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787855972.349234:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787855972.349240:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787855972.349911:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787855972.349918:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787855972.350517:0:14342:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787855972.350694:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787855972.350699:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787855972.352261:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787855972.352271:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787855972.373081:0:14342:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787855972.373295:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787855972.373303:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787855972.378094:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787855972.378109:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787855972.380081:0:14342:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787855972.380096:0:14342:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787855972.381609:0:14342:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787855972.381638:0:14342:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787855972.381645:0:14342:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787855972.382012:0:14342:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787855972.382048:0:14342:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.138@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787855972.382053:0:14342:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787855972.382054:0:14342:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787855972.382056:0:14342:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787855972.382057:0:14342:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787855972.382058:0:14342:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787855972.382059:0:14342:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787855972.382060:0:14342:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787855972.382062:0:14342:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787855972.382064:0:14342:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787855972.382065:0:14342:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787855972.382072:0:14342:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787855972.382074:0:14342:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787855972.382075:0:14342:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787855972.382075:0:14342:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787855972.382076:0:14342:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787855972.382077:0:14342:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787855972.382078:0:14342:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787855972.382079:0:14342:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787855972.382080:0:14342:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787855972.382081:0:14342:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787855972.382082:0:14342:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787855972.382109:0:14342:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787855972.382130:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486295808:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787855972.382201:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855972.382672:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0180 going to sleep for 11 seconds 00000100:00100000:1.0:1787855972.382735:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486295808 00000100:00100000:1.0:1787855972.382743:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486295808 00000100:00100000:1.0:1787855972.382988:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787855972.382999:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+5:14342:x1874702486295808:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787855972.383060:0:14355:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787855972.383063:0:14355:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787855972.383066:0:14355:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787855972.383489:0:14376:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787855972.384504:0:14355:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787855972.394068:0:14377:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787855972.394077:0:14377:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787855972.394080:0:14377:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787855972.394117:0:14377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787855972.396844:0:14355:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787855972.396863:0:14355:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787855972.418229:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+5:14342:x1874702486295808:12345-0@lo:253:mount.lustre.0 Request processed in 35223us (36019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855972.418257:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787855972.419663:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486295808:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787855972.419681:0:14342:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787855972.419684:0:14342:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787855972.419686:0:14342:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787855972.419688:0:14342:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787855972.419689:0:14342:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787855972.419690:0:14342:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787855972.419692:0:14342:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787855972.419693:0:14342:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787855972.419695:0:14342:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787855972.419696:0:14342:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787855972.419697:0:14342:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787855972.419719:0:14342:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a73f9d8a000 from lustre-MDT0000 10000000:01000000:1.0:1787855972.419744:0:14342:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787855972.419746:0:14342:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787855972.419751:0:14342:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a72c2bd4d70 10000000:01000000:1.0:1787855972.419754:0:14342:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787855972.419772:0:14342:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a72c2bd4d70 from 1 10000000:01000000:1.0:1787855972.419906:0:14342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787855972.419944:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ff800/0x516929ca3366e605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.419955:0:14342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ff800/0x516929ca3366e605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.419965:0:14342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ff800/0x516929ca3366e605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855972.420040:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486295936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787855972.420096:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855972.420131:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9acb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787855972.420336:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486295936 00000100:00100000:2.0:1787855972.420343:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486295936 00000100:00100000:2.0:1787855972.420394:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787855972.420404:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+5:14342:x1874702486295936:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787855972.420417:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855972.420433:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73f7887e00/0x516929ca3366e60c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e605 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.420455:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73f7887e00/0x516929ca3366e60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e605 expref: 6 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.420465:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73f7887e00/0x516929ca3366e60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e605 expref: 6 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.420473:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887e00, rc 0) 00000100:00100000:2.0:1787855972.420519:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+6:14342:x1874702486295936:12345-0@lo:101:mount.lustre.0 Request processed in 115us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855972.420526:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787855972.420753:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486295936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787855972.420767:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ff800/0x516929ca3366e605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e60c expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.420907:0:14342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ff800/0x516929ca3366e605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e60c expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855972.420955:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486296064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787855972.421045:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855972.421068:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9acb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787855972.421187:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486296064 00000100:00100000:2.0:1787855972.421192:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486296064 00000100:00100000:2.0:1787855972.421254:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787855972.421262:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+6:14342:x1874702486296064:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787855972.421503:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+6:14342:x1874702486296064:12345-0@lo:501:mount.lustre.0 Request processed in 242us (519us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787855972.421511:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787855972.421673:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486296064:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787855972.421700:0:14342:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787855972.421720:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ff800/0x516929ca3366e605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e60c expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.421739:0:14342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ff800/0x516929ca3366e605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e60c expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787855972.421748:0:14342:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a73f9d8a000 10000000:01000000:1.0:1787855972.421752:0:14342:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787855972.421756:0:14342:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a73f9d8a000 10000000:01000000:1.0:1787855972.421758:0:14342:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787855972.421761:0:14342:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a73f9d8a000 from 1 10000000:01000000:1.0:1787855972.421763:0:14342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787855972.421813:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fea00/0x516929ca3366e613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.421821:0:14342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fea00/0x516929ca3366e613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.421828:0:14342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fea00/0x516929ca3366e613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855972.421841:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486296192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787855972.421867:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855972.422506:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9acb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787855972.422645:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486296192 00000100:00100000:0.0:1787855972.422651:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486296192 00000100:00100000:0.0:1787855972.422685:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787855972.422693:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+6:14342:x1874702486296192:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787855972.422703:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855972.422719:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c5143600/0x516929ca3366e61a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e613 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855972.422739:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c5143600/0x516929ca3366e61a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e613 expref: 7 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855972.422748:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c5143600/0x516929ca3366e61a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e613 expref: 7 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855972.422755:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143600, rc 0) 00000100:00100000:0.0:1787855972.422836:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+7:14342:x1874702486296192:12345-0@lo:101:mount.lustre.0 Request processed in 143us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855972.422843:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787855972.422975:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486296192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787855972.422998:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fea00/0x516929ca3366e613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e61a expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.423007:0:14342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fea00/0x516929ca3366e613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e61a expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787855972.423037:0:14342:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787855972.423054:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fea00/0x516929ca3366e613 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e61a expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.423062:0:14342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fea00/0x516929ca3366e613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e61a expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787855972.423068:0:14342:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787855972.423072:0:14342:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787855972.423077:0:14342:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a73f9d8a000 10000000:01000000:1.0:1787855972.423079:0:14342:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787855972.423082:0:14342:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787855972.423084:0:14342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787855972.423102:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ffa00/0x516929ca3366e621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.423110:0:14342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ffa00/0x516929ca3366e621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.423117:0:14342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ffa00/0x516929ca3366e621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855972.423133:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486296320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787855972.423160:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855972.423178:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9acb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787855972.423288:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486296320 00000100:00100000:0.0:1787855972.423293:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486296320 00000100:00100000:0.0:1787855972.423313:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787855972.423319:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+7:14342:x1874702486296320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787855972.423333:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855972.423341:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c5142600/0x516929ca3366e628 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e621 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855972.423354:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c5142600/0x516929ca3366e628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e621 expref: 8 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855972.423362:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c5142600/0x516929ca3366e628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e621 expref: 8 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855972.423368:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142600, rc 0) 00000100:00100000:0.0:1787855972.423403:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+8:14342:x1874702486296320:12345-0@lo:101:mount.lustre.0 Request processed in 84us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855972.423409:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787855972.423474:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486296320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787855972.423485:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ffa00/0x516929ca3366e621 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e628 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.423498:0:14342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ffa00/0x516929ca3366e621 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e628 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855972.423537:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486296448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787855972.423575:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855972.423594:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9acb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787855972.423699:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486296448 00000100:00100000:0.0:1787855972.423703:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486296448 00000100:00100000:0.0:1787855972.423722:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787855972.423727:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c817bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+8:14342:x1874702486296448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787855972.424099:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c817bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+9:14342:x1874702486296448:12345-0@lo:501:mount.lustre.0 Request processed in 370us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855972.424107:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787855972.425026:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486296448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787855972.425074:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486296576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787855972.425131:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855972.425170:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9acb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787855972.425272:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486296576 00000100:00100000:0.0:1787855972.425277:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486296576 00000100:00100000:0.0:1787855972.425309:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787855972.425323:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c817a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+9:14342:x1874702486296576:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787855972.425683:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c817a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+9:14342:x1874702486296576:12345-0@lo:503:mount.lustre.0 Request processed in 359us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855972.425700:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787855972.427362:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486296576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787855972.427955:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff37be87-90a7-463b-b734-d2f25b77f044:14378:1874702486296704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787855972.428028:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855972.428072:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9ac300 going to sleep for 11 seconds 00000100:00100000:0.0:1787855972.428173:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486296704 00000100:00100000:0.0:1787855972.428180:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486296704 00000100:00100000:0.0:1787855972.428215:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787855972.428223:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c817a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+9:14378:x1874702486296704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855972.428532:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c817a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+9:14378:x1874702486296704:12345-0@lo:502:llog_process_th.0 Request processed in 309us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855972.428548:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787855972.428884:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff37be87-90a7-463b-b734-d2f25b77f044:14378:1874702486296704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787855972.428910:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787855972.428924:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.428927:0:14378:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787855972.428935:0:14378:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787855972.428939:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787855972.428953:0:14378:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a72c2bd33a0) 00000020:00000080:1.0:1787855972.428972:0:14378:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787855972.428977:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787855972.429051:0:14378:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787855972.429059:0:14378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x516929ca3366e636 00000020:00000080:1.0:1787855972.429272:0:14378:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787855972.429277:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787855972.429280:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.429282:0:14378:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787855972.429285:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787855972.429288:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.429290:0:14378:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787855972.429293:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787855972.429301:0:14378:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a72c2bd0000) 00000020:00000080:1.0:1787855972.429324:0:14378:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787855972.429329:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787855972.429331:0:14378:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787855972.429334:0:14378:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787855972.429340:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787855972.429380:0:14378:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a73f9d8a000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787855972.429400:0:14378:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a73c44699d0) 00000020:00000080:1.0:1787855972.429408:0:14378:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787855972.429464:0:14378:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787855972.429470:0:14378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x516929ca3366e64b 00000020:00000080:1.0:1787855972.429571:0:14378:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787855972.429576:0:14378:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787855972.429581:0:14378:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x516929ca3366e652 00080000:01000000:1.0:1787855972.429585:0:14378:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787855972.429588:0:14378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x516929ca3366e659 00010000:00010000:2.0:1787855972.537932:0:14378:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787855972.538589:0:14378:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787855972.538887:0:14378:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787855972.539767:0:14378:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a74004c8000) 00000020:00000080:2.0:1787855972.539874:0:14378:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787855972.539941:0:14378:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787855972.539950:0:14378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x516929ca3366e667 00000020:00000080:3.0:1787855972.550099:0:14378:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787855972.560141:0:14378:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x516929ca3366e66e 00000020:00000080:1.0:1787855972.560948:0:14378:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787855972.560961:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787855972.560968:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.560970:0:14378:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787855972.560976:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787855972.560979:0:14378:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1787855972.560981:0:14378:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787855972.560982:0:14378:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787855972.560984:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787855972.560986:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.560993:0:14378:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787855972.560997:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787855972.561002:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.561003:0:14378:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787855972.561008:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787855972.561045:0:14378:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787855972.561059:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787855972.561063:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.561065:0:14378:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787855972.561067:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787855972.561071:0:14378:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787855972.561074:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.561076:0:14378:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787855972.561079:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787855972.561084:0:14378:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:01000000:1.0:1787855972.561112:0:14378:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787855972.561115:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787855972.561130:0:14378:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a73c446b3a0) 00000020:00000080:1.0:1787855972.561147:0:14378:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787855972.561152:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787855972.561203:0:14378:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787855972.561209:0:14378:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787855972.561214:0:14378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x516929ca3366e67c 00010000:00080000:1.0:1787855972.561244:0:14378:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a73eb7f9800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:1.0:1787855972.561511:0:14378:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787855972.561913:0:14378:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787855972.561955:0:14378:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787855972.562873:0:14378:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787855972.562935:0:14378:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787855972.563005:0:14378:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787855972.563376:0:14382:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787855972.563380:0:14382:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787855972.568043:0:14378:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787855972.568057:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787855972.568094:0:14378:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787855972.568113:0:14378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x516929ca3366e683 00000100:00080000:1.0:1787855972.568123:0:14378:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787855972.568129:0:14378:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a73eb7f9800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1787855972.568166:0:14378:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73df8492c0 x1874702486296832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787855972.568193:0:14378:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787855972.568241:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787855972.568245:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.568246:0:14378:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787855972.568249:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787855972.568252:0:14378:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787855972.568253:0:14378:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787855972.568255:0:14378:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787855972.568256:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787855972.568258:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.568259:0:14378:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787855972.568262:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787855972.568266:0:14378:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787855972.568269:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.568271:0:14378:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787855972.568273:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787855972.568277:0:14378:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.138@tcp to nid 0x20000c0a8c98a (192.168.201.138@tcp) 00000020:01000000:1.0:1787855972.568300:0:14378:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787855972.568303:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787855972.568327:0:14378:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a73c446cd70) 00000020:00000080:1.0:1787855972.568340:0:14378:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787855972.568344:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787855972.568394:0:14378:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787855972.568404:0:14378:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787855972.568411:0:14378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x516929ca3366e691 00010000:00080000:1.0:1787855972.568438:0:14378:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a73fa532000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:1.0:1787855972.568659:0:14378:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787855972.568875:0:14378:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787855972.568896:0:14378:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787855972.569474:0:14378:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787855972.569547:0:14378:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000100:00100000:3.0:1787855972.570000:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486296832:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787855972.570067:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874702486296832 offset 0 length 520: 4 00000040:00080000:1.0:1787855972.575232:0:14378:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787855972.576269:0:14384:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787855972.576292:0:14384:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787855972.577494:0:14378:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787855972.577508:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787855972.577539:0:14378:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787855972.577559:0:14378:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x516929ca3366e698 00000100:00080000:1.0:1787855972.577570:0:14378:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787855972.577577:0:14378:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a73fa532000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1787855972.577623:0:14378:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73df849e00 x1874702486296960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787855972.577687:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486296960:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787855972.577753:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874702486296960 offset 0 length 520: 4 00000100:00080000:1.0:1787855972.577985:0:14378:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787855972.578036:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787855972.578040:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.578043:0:14378:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787855972.578046:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787855972.578050:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.578052:0:14378:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787855972.578054:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787855972.578056:0:14378:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787855972.578059:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787855972.578061:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.578062:0:14378:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787855972.578064:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787855972.578067:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.578073:0:14378:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787855972.578078:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787855972.578112:0:14378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff37be87-90a7-463b-b734-d2f25b77f044:14378:1874702486297088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787855972.578163:0:14378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855972.578187:0:14378:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9acc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787855972.578327:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486297088 00000100:00100000:0.0:1787855972.578334:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486297088 00000100:00100000:0.0:1787855972.578381:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787855972.578390:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8179450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+9:14378:x1874702486297088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855972.578645:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8179450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+9:14378:x1874702486297088:12345-0@lo:502:llog_process_th.0 Request processed in 255us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855972.578652:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787855972.579064:0:14378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff37be87-90a7-463b-b734-d2f25b77f044:14378:1874702486297088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787855972.579093:0:14378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787855972.579098:0:14378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.579100:0:14378:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787855972.579103:0:14378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787855972.579503:0:14342:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787855972.579524:0:14342:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787855972.579539:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ffa00/0x516929ca3366e621 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e628 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855972.579551:0:14342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ffa00/0x516929ca3366e621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e628 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855972.579558:0:14342:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a73f9d8a000 from 1 10000000:01000000:0.0:1787855972.579561:0:14342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787855972.579591:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e69f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855972.579621:0:14342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e69f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855972.579630:0:14342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e69f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855972.579646:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486297216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787855972.579689:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855972.579762:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855972.582507:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486297216 00000100:00100000:2.0:1787855972.582521:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486297216 00000100:00100000:2.0:1787855972.582617:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787855972.582629:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8178850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+9:14342:x1874702486297216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787855972.582645:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855972.582666:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73f7887600/0x516929ca3366e6a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e69f expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.582694:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73f7887600/0x516929ca3366e6a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e69f expref: 10 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.582705:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73f7887600/0x516929ca3366e6a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e69f expref: 10 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.582714:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887600, rc 0) 00000100:00100000:2.0:1787855972.582818:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8178850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+10:14342:x1874702486297216:12345-0@lo:101:mount.lustre.0 Request processed in 191us (3127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855972.582824:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787855972.582922:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486297216:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787855972.582939:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e69f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e6a6 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.582948:0:14342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e69f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e6a6 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855972.583688:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486297344:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787855972.583744:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855972.585174:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9acc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787855972.587252:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486297344 00000100:00100000:0.0:1787855972.587267:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486297344 00000100:00100000:0.0:1787855972.587343:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787855972.587353:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c817b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+10:14342:x1874702486297344:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787855972.587379:0:14354:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787855972.587385:0:14354:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787855972.587502:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c817b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+10:14342:x1874702486297344:12345-0@lo:256:mount.lustre.0 Request processed in 150us (3756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855972.587510:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787855972.587702:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486297344:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787855972.588329:0:14342:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787855972.588352:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e69f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e6a6 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.588365:0:14342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e69f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e6a6 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787855972.588390:0:14342:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73f9d8a000 from 1 10000000:01000000:1.0:1787855972.588393:0:14342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787855972.588427:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e6ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.588435:0:14342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e6ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.588446:0:14342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e6ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855972.588468:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486297472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787855972.588513:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855972.588547:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9acc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787855972.588968:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486297472 00000100:00100000:0.0:1787855972.588976:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486297472 00000100:00100000:0.0:1787855972.589009:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787855972.589016:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+10:14342:x1874702486297472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787855972.589026:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855972.589040:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c5143a00/0x516929ca3366e6b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e6ad expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855972.589063:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c5143a00/0x516929ca3366e6b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e6ad expref: 11 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855972.589081:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c5143a00/0x516929ca3366e6b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e6ad expref: 11 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855972.589090:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143a00, rc 0) 00000100:00100000:0.0:1787855972.589129:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+11:14342:x1874702486297472:12345-0@lo:101:mount.lustre.0 Request processed in 114us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855972.589135:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787855972.590319:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486297472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787855972.590341:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e6ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e6b4 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.590351:0:14342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e6ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e6b4 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855972.590421:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486297600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787855972.590478:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855972.590519:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9acc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787855972.590681:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486297600 00000100:00100000:0.0:1787855972.590688:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486297600 00000100:00100000:0.0:1787855972.590719:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787855972.590728:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+11:14342:x1874702486297600:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787855972.591155:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+11:14342:x1874702486297600:12345-0@lo:501:mount.lustre.0 Request processed in 426us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855972.591163:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787855972.592741:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486297600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787855972.592818:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486297728:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787855972.592894:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855972.592943:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9acc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787855972.593382:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486297728 00000100:00100000:0.0:1787855972.593389:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486297728 00000100:00100000:0.0:1787855972.593429:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787855972.593439:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+11:14342:x1874702486297728:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787855972.593654:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+11:14342:x1874702486297728:12345-0@lo:503:mount.lustre.0 Request processed in 215us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855972.593661:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787855972.593746:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486297728:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787855972.594327:0:14386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff37be87-90a7-463b-b734-d2f25b77f044:14386:1874702486297856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787855972.594373:0:14386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855972.594404:0:14386:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9ac600 going to sleep for 11 seconds 00000100:00100000:0.0:1787855972.594524:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486297856 00000100:00100000:0.0:1787855972.594528:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486297856 00000100:00100000:0.0:1787855972.594565:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787855972.594573:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+11:14386:x1874702486297856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855972.594765:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+11:14386:x1874702486297856:12345-0@lo:502:llog_process_th.0 Request processed in 192us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855972.594810:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787855972.594887:0:14386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff37be87-90a7-463b-b734-d2f25b77f044:14386:1874702486297856:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787855972.594905:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787855972.594913:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.594914:0:14386:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787855972.594920:0:14386:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a73f9d8a000 00000020:00000080:1.0:1787855972.594922:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787855972.594927:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787855972.594929:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.594930:0:14386:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787855972.594931:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787855972.594932:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.594933:0:14386:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787855972.594935:0:14386:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a73f9d8a000 00000020:00000080:1.0:1787855972.594936:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787855972.594980:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787855972.594983:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.594983:0:14386:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787855972.594985:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787855972.594986:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787855972.594987:0:14386:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787855972.594989:0:14386:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a73f9d8a000 00000020:00000080:1.0:1787855972.594990:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787855972.595020:0:14386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff37be87-90a7-463b-b734-d2f25b77f044:14386:1874702486297984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787855972.595059:0:14386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855972.595084:0:14386:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9ac600 going to sleep for 11 seconds 00000100:00100000:3.0:1787855972.595097:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486297984 00000100:00100000:3.0:1787855972.595102:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486297984 00000100:00100000:3.0:1787855972.595188:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787855972.595196:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+11:14386:x1874702486297984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787855972.595355:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+11:14386:x1874702486297984:12345-0@lo:502:llog_process_th.0 Request processed in 160us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855972.595362:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787855972.595423:0:14386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff37be87-90a7-463b-b734-d2f25b77f044:14386:1874702486297984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787855972.595442:0:14386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787855972.595446:0:14386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787855972.595448:0:14386:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787855972.595457:0:14386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787855972.597697:0:14342:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787855972.597727:0:14342:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787855972.597751:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e6ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e6b4 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.597762:0:14342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e6ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e6b4 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855972.597917:0:14342:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787855972.597921:0:14342:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a73f9d8a000 10000000:01000000:2.0:1787855972.597924:0:14342:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a73f9d8a000 10000000:01000000:2.0:1787855972.597928:0:14342:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787855972.597933:0:14342:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a73f9d8a000 from 1 10000000:01000000:2.0:1787855972.597936:0:14342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787855972.597970:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73f7886800/0x516929ca3366e6bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.597978:0:14342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73f7886800/0x516929ca3366e6bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.598058:0:14342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73f7886800/0x516929ca3366e6bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855972.598083:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb675e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486298112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787855972.598141:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855972.598175:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6900 going to sleep for 11 seconds 00000100:00100000:0.0:1787855972.605194:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486298112 00000100:00100000:0.0:1787855972.605207:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486298112 00000100:00100000:0.0:1787855972.607707:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787855972.607724:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+11:14342:x1874702486298112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787855972.607741:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787855972.607759:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c5142c00/0x516929ca3366e6c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e6bb expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855972.607799:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c5142c00/0x516929ca3366e6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e6bb expref: 12 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855972.607810:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c5142c00/0x516929ca3366e6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e6bb expref: 12 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855972.607819:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142c00, rc 0) 00000100:00100000:0.0:1787855972.607895:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+12:14342:x1874702486298112:12345-0@lo:101:mount.lustre.0 Request processed in 177us (9753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855972.607902:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787855972.611232:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb675e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486298112:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787855972.611264:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73f7886800/0x516929ca3366e6bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e6c2 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.614893:0:14342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73f7886800/0x516929ca3366e6bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e6c2 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855972.615079:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb675e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486298240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787855972.615147:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855972.615395:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787855972.615500:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486298240 00000100:00100000:1.0:1787855972.615507:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486298240 00000100:00100000:1.0:1787855972.615555:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787855972.615565:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+12:14342:x1874702486298240:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787855972.615860:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+12:14342:x1874702486298240:12345-0@lo:501:mount.lustre.0 Request processed in 295us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855972.615868:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787855972.617355:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb675e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486298240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787855972.617412:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb675e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486298368:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787855972.617472:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855972.617507:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787855972.617694:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486298368 00000100:00100000:1.0:1787855972.617700:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486298368 00000100:00100000:1.0:1787855972.617735:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787855972.617743:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+12:14342:x1874702486298368:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787855972.617957:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+12:14342:x1874702486298368:12345-0@lo:503:mount.lustre.0 Request processed in 213us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855972.617964:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787855972.618101:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb675e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486298368:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787855972.618289:0:14389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb675e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff37be87-90a7-463b-b734-d2f25b77f044:14389:1874702486298496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787855972.618337:0:14389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855972.618356:0:14389:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6540 going to sleep for 11 seconds 00000100:00100000:1.0:1787855972.618453:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486298496 00000100:00100000:1.0:1787855972.618458:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486298496 00000100:00100000:1.0:1787855972.618479:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787855972.618486:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+12:14389:x1874702486298496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787855972.619297:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+12:14389:x1874702486298496:12345-0@lo:502:llog_process_th.0 Request processed in 806us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855972.619305:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787855972.620270:0:14389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb675e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff37be87-90a7-463b-b734-d2f25b77f044:14389:1874702486298496:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787855972.620405:0:14389:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787855972.620420:0:14389:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a74004c99d0) 00000020:00000080:2.0:1787855972.620442:0:14389:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787855972.620521:0:14389:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a73f9d8a000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787855972.620526:0:14389:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a73f9d8a000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787855972.620528:0:14389:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a73f9d8a000 4 00010000:00080000:2.0:1787855972.620650:0:14389:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a73c44a7000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.138@tcp at head 00010000:00010000:0.0:1787855972.627141:0:14389:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1787855972.627360:0:14389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787855972.627398:0:14389:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787855972.628947:0:14389:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x516929ca3366e6d0 00000100:00080000:0.0:1787855972.628965:0:14389:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787855972.628972:0:14389:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a73c44a7000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1787855972.629019:0:14389:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a72c2e0ad00 x1874702486298624/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787855972.629072:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874702486298624:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787855972.629143:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787855972.629202:0:14389:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787855972.629445:0:14389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff37be87-90a7-463b-b734-d2f25b77f044:14389:1874702486298752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787855972.629489:0:14389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855972.629506:0:14389:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c24a4000 going to sleep for 11 seconds 00000100:00100000:3.0:1787855972.631715:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486298624 00000100:00100000:3.0:1787855972.631737:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486298624 00000100:00100000:3.0:1787855972.632094:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787855972.632103:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874702486298624:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787855972.632192:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874702486298624:12345-0@lo:38:llog_process_th.0 Request processed in 90us (3049us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787855972.632199:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787855972.634152:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787855972.634164:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73c44a7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787855972.634171:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787855972.634175:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874702486298624:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787855972.635137:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486298752 00000100:00100000:1.0:1787855972.635146:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486298752 00000100:00100000:1.0:1787855972.635203:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787855972.635213:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+12:14389:x1874702486298752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787855972.635642:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+12:14389:x1874702486298752:12345-0@lo:502:llog_process_th.0 Request processed in 428us (6151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855972.635651:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787855972.636143:0:14389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ff37be87-90a7-463b-b734-d2f25b77f044:14389:1874702486298752:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787855972.636180:0:14389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787855972.636844:0:14342:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787855972.636867:0:14342:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787855972.636885:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73f7886800/0x516929ca3366e6bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e6c2 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855972.636897:0:14342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73f7886800/0x516929ca3366e6bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e6c2 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787855972.636943:0:14342:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787855972.636946:0:14342:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787855972.636947:0:14342:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787855972.636948:0:14342:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787855972.636950:0:14342:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787855972.636951:0:14342:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787855972.636952:0:14342:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787855972.636959:0:14342:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787855972.636961:0:14342:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787855972.636962:0:14342:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787855972.636966:0:14342:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1787855972.636968:0:14342:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787855972.636969:0:14342:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787855972.636970:0:14342:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787855972.636971:0:14342:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787855972.636971:0:14342:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787855972.636973:0:14342:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787855972.636974:0:14342:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787855972.636974:0:14342:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787855972.636975:0:14342:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787855972.636976:0:14342:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787855972.637075:0:14342:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787855972.637094:0:14342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486298880:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787855972.637161:0:14342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855972.637205:0:14342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c24a4000 going to sleep for 11 seconds 00000100:00100000:3.0:1787855972.638848:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486298880 00000100:00100000:3.0:1787855972.638861:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486298880 00000100:00100000:3.0:1787855972.639076:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787855972.639088:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+12:14342:x1874702486298880:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787855972.639119:0:14355:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787855972.639134:0:14355:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787855972.751010:0:14355:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787855972.751027:0:14355:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787855972.751135:0:14376:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787855972.751139:0:14376:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787855972.751164:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a73c166c400/0x516929ca3366e6d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855972.751180:0:14376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73f7887600/0x516929ca3366e6a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e69f expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855972.751186:0:14376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a73c166c400/0x516929ca3366e6d7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855972.751219:0:14376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73f7887600/0x516929ca3366e6a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366e69f expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855972.751232:0:14376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a73f7887600/0x516929ca3366e6a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366e69f expref: 12 pid: 14353 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855972.751243:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7648b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14376:1874702486299008:0@lo:104: 00000100:00100000:3.0:1787855972.751318:0:14376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855972.751374:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0240 going to sleep for 11 seconds 00000100:00100000:1.0:1787855972.751682:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486299008 00000100:00100000:1.0:1787855972.751690:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486299008 00000100:00100000:1.0:1787855972.751732:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787855972.751741:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff37be87-90a7-463b-b734-d2f25b77f044+3:14376:x1874702486299008:12345-0@lo:104: 00010000:00010000:1.0:1787855972.751753:0:14343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e69f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366e6a6 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.751842:0:14343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787855972.751849:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ff37be87-90a7-463b-b734-d2f25b77f044+3:14376:x1874702486299008:12345-0@lo:104: Request processed in 109us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855972.751857:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787855972.751878:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787855972.751883:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e69f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366e6a6 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.751891:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143e00 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:1.0:1787855972.751895:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e69f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366e6a6 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.751903:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e69f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366e6a6 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787855972.751910:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e69f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366e6a6 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787855972.751928:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787855972.751965:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e69f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e6a6 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.751971:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787855972.751991:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e69f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e6a6 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.751998:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e69f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e6a6 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855972.752014:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855972.752016:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855972.752017:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855972.752025:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7648b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14376:1874702486299008:0@lo:104: 00000100:00100000:1.0:1787855972.752037:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff37be87-90a7-463b-b734-d2f25b77f044:3306:1874702486299136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787855972.752045:0:14376:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a73c166c400/0x516929ca3366e6d7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855972.752065:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855972.752098:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486299136 00000100:00100000:2.0:1787855972.752102:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486299136 00010000:00010000:2.0:1787855972.752120:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73f7887600/0x516929ca3366e6a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366e69f expref: 13 pid: 14353 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855972.752152:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787855972.752159:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff37be87-90a7-463b-b734-d2f25b77f044+13:3306:x1874702486299136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787855972.752169:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855972.752173:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73f7887600/0x516929ca3366e6a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366e69f expref: 13 pid: 14353 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.752188:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73f7887600/0x516929ca3366e6a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366e69f expref: 13 pid: 14353 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.752201:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73f7887600/0x516929ca3366e6a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366e69f expref: 13 pid: 14353 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.752216:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a73c166c400/0x516929ca3366e6d7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.752224:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c166c400/0x516929ca3366e6d7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787855972.752237:0:14345:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001098328s 00010000:00010000:2.0:1787855972.752241:0:14345:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73c166c400/0x516929ca3366e6d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.752247:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73c166c400/0x516929ca3366e6d7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.752263:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a73c166c400/0x516929ca3366e6d7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.752269:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a73c166c400/0x516929ca3366e6d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.752275:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166c400 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:2.0:1787855972.752280:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a73c166c400/0x516929ca3366e6d7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.752287:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a73c166c400/0x516929ca3366e6d7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.752301:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a73c166c400/0x516929ca3366e6d7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.752310:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855972.752341:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff37be87-90a7-463b-b734-d2f25b77f044+12:3306:x1874702486299136:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855972.752348:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787855972.752367:0:14376:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a73c166c400/0x516929ca3366e6d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.752374:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a73c166c400/0x516929ca3366e6d7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855972.752380:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c166c400/0x516929ca3366e6d7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855972.752505:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff37be87-90a7-463b-b734-d2f25b77f044:3306:1874702486299136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787855972.784223:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+11:14342:x1874702486298880:12345-0@lo:253:mount.lustre.0 Request processed in 145129us (147054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855972.784235:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787855972.784693:0:14342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:14342:1874702486298880:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787855972.784709:0:14342:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787855972.784712:0:14342:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787855972.784714:0:14342:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787855972.784715:0:14342:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787855972.784716:0:14342:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787855972.784717:0:14342:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787855972.784718:0:14342:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787855972.784719:0:14342:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787855972.784721:0:14342:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787855972.784722:0:14342:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787855972.784724:0:14342:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787855972.784739:0:14342:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787855972.799591:0:14342:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787855972.799828:0:14342:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787855972.800111:0:14342:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787855972.800277:0:14342:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787855972.800654:0:14342:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855972.800914:0:14342:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787855972.811526:0:14342:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855972.811727:0:14342:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787855972.812179:0:14342:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855972.812396:0:14342:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787855972.812641:0:14342:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855972.813312:0:14342:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787855972.869913:0:14342:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787855972.870327:0:14342:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787855972.871405:0:14398:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787855972.871493:0:14398:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787855972.879150:0:14398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787855972.879217:0:14398:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787855972.879222:0:14398:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1787855972.880218:0:14342:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787855972.880420:0:14342:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787855972.880754:0:14397:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787855972.880759:0:14397:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:2.0:1787855972.881094:0:14342:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787855972.881104:0:14342:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787855972.881252:0:14342:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787855972.883211:0:14342:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787855972.884447:0:14342:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787855972.884499:0:14342:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787855972.887524:0:14342:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787855972.894427:0:14342:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787855972.934639:0:14342:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787855972.934678:0:14342:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb34381ce3988 00100000:10000000:3.0:1787855972.934686:0:14342:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787855972.939092:0:14342:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787855972.939111:0:14342:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787855972.939126:0:14342:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787855972.939147:0:14342:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787855973.250490:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787855973.693481:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787855974.140824:0:14357:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787855974.140831:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a73f9d8a000 from 6 10000000:01000000:0.0:1787855974.140835:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787855974.140886:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143400/0x516929ca3366e6de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855974.140899:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c5143400/0x516929ca3366e6de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855974.140911:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c5143400/0x516929ca3366e6de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855974.140935:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486299264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787855974.141009:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855974.141056:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787855974.141194:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486299264 00000100:00100000:1.0:1787855974.141201:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486299264 00000100:00100000:1.0:1787855974.141258:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787855974.141267:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+11:14357:x1874702486299264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787855974.141288:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855974.141303:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73fa6ff600/0x516929ca3366e6e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e6de expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855974.141332:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73fa6ff600/0x516929ca3366e6e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e6de expref: 12 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855974.141342:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73fa6ff600/0x516929ca3366e6e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e6de expref: 12 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855974.141351:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ff600, rc 0) 00000100:00100000:1.0:1787855974.141395:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+12:14357:x1874702486299264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855974.141402:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787855974.141769:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486299264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855974.141814:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c5143400/0x516929ca3366e6de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e6e5 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855974.141823:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c5143400/0x516929ca3366e6de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e6e5 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855974.141877:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7649680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486299392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787855974.141912:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855974.141939:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73faa62180 going to sleep for 11 seconds 00000100:00100000:1.0:1787855974.142201:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486299392 00000100:00100000:1.0:1787855974.142206:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486299392 00000100:00100000:1.0:1787855974.142244:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787855974.142252:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c600b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+12:14357:x1874702486299392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787855974.142266:0:14355:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787855974.142294:0:14355:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787855974.142298:0:14355:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787855974.142378:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c600b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+12:14357:x1874702486299392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855974.142384:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787855974.142537:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7649680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486299392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787855974.142592:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787855974.142599:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143400/0x516929ca3366e6de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e6e5 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855974.142608:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c5143400/0x516929ca3366e6de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e6e5 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855974.267991:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787855974.718197:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787855975.292908:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855976.315916:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855977.340850:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787855977.883319:0:14640:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1787855978.110701:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787855978.110708:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787855978.110711:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787855978.110726:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787855978.110729:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787855978.110733:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787855978.110737:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a73c44a7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787855978.110749:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a73c44a7000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1787855978.110791:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73df84b840 x1874702486299648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787855978.110827:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff37be87-90a7-463b-b734-d2f25b77f044:3307:1874702486299520:0@lo:400:kworker.0 00000100:00100000:1.0:1787855978.110899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855978.110994:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486299520 00000100:00100000:1.0:1787855978.111003:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486299520 00000100:00100000:1.0:1787855978.111053:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787855978.111063:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c600ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+12:3307:x1874702486299520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855978.111118:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c600ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+12:3307:x1874702486299520:12345-0@lo:400:kworker.0 Request processed in 56us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855978.111126:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787855978.111185:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ff37be87-90a7-463b-b734-d2f25b77f044:3307:1874702486299520:0@lo:400:kworker.0 00000100:00100000:0.0:1787855978.111452:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874702486299648:0@lo:38:kworker.0 00000100:00100000:0.0:1787855978.111491:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855978.111699:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486299648 00000100:00100000:1.0:1787855978.111705:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486299648 00000100:00100000:1.0:1787855978.111734:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787855978.111741:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874702486299648:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787855978.111764:0:14362:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:1.0:1787855978.111822:0:14362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x516929ca3366e6ec 00000004:00100000:1.0:1787855978.111840:0:14362:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787855978.112104:0:14362:0:(import.c:65:import_set_state_nolock()) ffff9a73fa3ce800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787855978.112172:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874702486299648:12345-0@lo:38:kworker.0 Request processed in 430us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855978.112181:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787855978.112326:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a73df84b840 x1874702486299648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787855988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787855978.112342:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787855978.112351:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787855978.112356:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787855978.112358:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73c44a7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787855978.112365:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874702486299648:0@lo:38:kworker.0 00010000:00010000:3.0:1787855978.364035:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855979.391982:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855980.412221:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787855981.154500:0:14792:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea086f550 20000000:00000080:0.0:1787855981.154518:0:14792:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a73f7e13c00 uarg=0000000000000000 20000000:01000000:0.0:1787855981.154553:0:14792:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787855981.154560:0:14792:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787855981.154565:0:14792:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787855981.157159:0:14793:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1787855981.157375:0:14792:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787855981.168140:0:14792:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787855981.168170:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e6f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855981.168189:0:14792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c5143a00/0x516929ca3366e6b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e6ad expref: 11 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855981.168196:0:14792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e6f3 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855981.168237:0:14792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c5143a00/0x516929ca3366e6b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366e6ad expref: 11 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855981.168253:0:14792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a73c5143a00/0x516929ca3366e6b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366e6ad expref: 11 pid: 14354 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855981.168266:0:14792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8483c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14792:1874702486299776:0@lo:104: 00000100:00100000:1.0:1787855981.168332:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855981.168437:0:14792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d0662000 going to sleep for 11 seconds 00000100:00100000:0.0:1787855981.168510:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486299776 00000100:00100000:0.0:1787855981.168518:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486299776 00000100:00100000:0.0:1787855981.168732:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787855981.168741:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df848b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff37be87-90a7-463b-b734-d2f25b77f044+3:14792:x1874702486299776:12345-0@lo:104: 00010000:00010000:0.0:1787855981.168755:0:14344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e6ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366e6b4 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855981.168858:0:14344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787855981.168864:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df848b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff37be87-90a7-463b-b734-d2f25b77f044+3:14792:x1874702486299776:12345-0@lo:104: Request processed in 125us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855981.168870:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787855981.168942:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787855981.168949:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e6ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366e6b4 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855981.168957:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe000 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:3.0:1787855981.168961:0:14348:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e6ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366e6b4 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855981.168970:0:14348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e6ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366e6b4 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787855981.168977:0:14348:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e6ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366e6b4 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787855981.168983:0:14348:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787855981.169011:0:14348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e6ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e6b4 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855981.169029:0:14348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787855981.169053:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e6ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e6b4 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855981.169060:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e6ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e6b4 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855981.169078:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855981.169080:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855981.169082:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855981.169111:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff37be87-90a7-463b-b734-d2f25b77f044:3304:1874702486299904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787855981.169144:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855981.169328:0:14792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8483c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14792:1874702486299776:0@lo:104: 00010000:00010000:1.0:1787855981.169345:0:14792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e6f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855981.169743:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486299904 00000100:00100000:2.0:1787855981.169749:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486299904 00010000:00010000:2.0:1787855981.169771:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c5143a00/0x516929ca3366e6b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366e6ad expref: 12 pid: 14354 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855981.170349:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787855981.170359:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7649680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff37be87-90a7-463b-b734-d2f25b77f044+12:3304:x1874702486299904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787855981.170372:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787855981.170380:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c5143a00/0x516929ca3366e6b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366e6ad expref: 12 pid: 14354 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855981.170391:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c5143a00/0x516929ca3366e6b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366e6ad expref: 12 pid: 14354 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855981.170405:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c5143a00/0x516929ca3366e6b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366e6ad expref: 12 pid: 14354 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855981.170432:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e6f3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855981.170440:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e6f3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855981.170463:0:14345:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e6f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855981.170469:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e6f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855981.170475:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e6f3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855981.170481:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e6f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855981.170487:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe400 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:2.0:1787855981.170491:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e6f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855981.170497:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e6f3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855981.170519:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e6f3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855981.170529:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787855981.170591:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7649680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff37be87-90a7-463b-b734-d2f25b77f044+11:3304:x1874702486299904:12345-0@lo:103:ldlm_bl.0 Request processed in 234us (1445us total) trans 0 rc 0/0 00010000:00010000:3.0:1787855981.170691:0:14792:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e6f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855981.170700:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e6f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855981.170706:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e6f3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855981.171584:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787855981.176968:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff37be87-90a7-463b-b734-d2f25b77f044:3304:1874702486299904:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787855981.436142:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855982.220940:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787855972/real 1787855972] req@ffff9a73df849e00 x1874702486296960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787855982 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855982.220971:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a73df849e00 x1874702486296960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787855982 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855982.220982:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787855972/real 1787855972] req@ffff9a73df8492c0 x1874702486296832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787855982 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855982.220993:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a73df8492c0 x1874702486296832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787855982 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787855982.221010:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73fa532000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787855982.221053:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787855982.221058:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486296960:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787855982.221064:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73eb7f9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787855982.221070:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787855982.221080:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486296832:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787855982.221317:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787855982.221328:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787855982.221331:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a73eb7f9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787855982.221336:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 463 00000100:00080000:1.0:1787855982.221341:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787855982.221347:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a73eb7f9800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1787855982.221370:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73df8492c0 x1874702486300160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787855982.221384:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787855982.221387:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787855982.221389:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a73fa532000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787855982.221391:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 463 00000100:00080000:1.0:1787855982.221394:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787855982.221397:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a73fa532000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1787855982.221407:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73df849e00 x1874702486300288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787855982.221462:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486300416:0@lo:400:kworker.0 00000100:00100000:1.0:1787855982.221546:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855982.221692:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787855982.221704:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff37be87-90a7-463b-b734-d2f25b77f044:3304:1874702486300032:0@lo:400:kworker.0 00000100:00100000:0.0:1787855982.221742:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855982.221798:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486300032 00000100:00100000:0.0:1787855982.221806:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486300032 00000100:00100000:0.0:1787855982.221850:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787855982.221858:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c6008050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+11:3304:x1874702486300032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787855982.221907:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c6008050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+11:3304:x1874702486300032:12345-0@lo:400:kworker.0 Request processed in 50us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855982.221914:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787855982.222254:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff37be87-90a7-463b-b734-d2f25b77f044:3304:1874702486300032:0@lo:400:kworker.0 00000100:00100000:3.0:1787855982.222504:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486300416 00000100:00100000:3.0:1787855982.222509:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486300416 00000100:00100000:3.0:1787855982.222550:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787855982.222558:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486300416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855982.222797:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486300416:12345-0@lo:400:kworker.0 Request processed in 218us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855982.222805:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787855982.222828:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486300160:0@lo:8:kworker.0 00000400:00000100:3.0:1787855982.222851:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874702486300160 offset 0 length 520: 4 00000100:00100000:3.0:1787855982.222871:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486300288:0@lo:8:kworker.0 00000400:00000100:3.0:1787855982.222886:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874702486300288 offset 0 length 520: 4 00010000:00080000:0.0:1787855982.222961:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a73df84bc00 x1874702486300416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787855998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855982.222973:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486300416:0@lo:400:kworker.0 00010000:00010000:1.0:1787855982.461458:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787855982.843865:0:14357:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787855982.843872:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73f9d8a000 from 10 10000000:01000000:3.0:1787855982.843877:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787855982.843917:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166d600/0x516929ca3366e6fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855982.843929:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c166d600/0x516929ca3366e6fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855982.843940:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c166d600/0x516929ca3366e6fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855982.843965:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7649e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486300544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787855982.844029:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855982.844080:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73faa62240 going to sleep for 11 seconds 00000100:00100000:1.0:1787855982.844225:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486300544 00000100:00100000:1.0:1787855982.844232:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486300544 00000100:00100000:1.0:1787855982.844293:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787855982.844303:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c600a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+11:14357:x1874702486300544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787855982.844327:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787855982.844340:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73fa6fe600/0x516929ca3366e701 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e6fa expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855982.844373:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73fa6fe600/0x516929ca3366e701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e6fa expref: 12 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855982.844382:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73fa6fe600/0x516929ca3366e701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e6fa expref: 12 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855982.844391:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe600, rc 0) 00000100:00100000:1.0:1787855982.844491:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c600a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+12:14357:x1874702486300544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855982.844508:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787855982.848352:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7649e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486300544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855982.848385:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c166d600/0x516929ca3366e6fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e701 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855982.848397:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c166d600/0x516929ca3366e6fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e701 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855982.848487:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7649e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486300672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855982.848718:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855982.848757:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73faa62240 going to sleep for 11 seconds 00000100:00100000:1.0:1787855982.848807:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486300672 00000100:00100000:1.0:1787855982.848811:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486300672 00000100:00100000:1.0:1787855982.848849:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787855982.848856:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c600b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+12:14357:x1874702486300672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787855982.849065:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c600b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+12:14357:x1874702486300672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855982.849073:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787855982.849168:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7649e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486300672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787855982.849197:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7649e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486300800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787855982.849260:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855982.849283:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73faa62240 going to sleep for 11 seconds 00000100:00100000:3.0:1787855982.849296:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486300800 00000100:00100000:3.0:1787855982.849300:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486300800 00000100:00100000:3.0:1787855982.849324:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787855982.849331:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c6008c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+12:14357:x1874702486300800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787855982.849811:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c6008c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+12:14357:x1874702486300800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 480us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855982.849816:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787855982.849850:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7649e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486300800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787855982.852032:0:14854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787855982.852216:0:14357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787855982.852237:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787855982.852249:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166d600/0x516929ca3366e6fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e701 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855982.852260:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c166d600/0x516929ca3366e6fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e701 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855983.496832:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855984.508110:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787855984.959053:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787855985.533408:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855986.557055:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787855986.800850:0:15042:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787855986.800854:0:15042:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787855986.800994:0:15042:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a73d8173000 00000020:01000004:0.0:1787855986.801011:0:15042:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787855986.801024:0:15042:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787855986.801037:0:15042:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a73c50e33a0) 00000020:00000080:0.0:1787855986.801052:0:15042:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787855986.823732:0:15042:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787855986.824025:0:15042:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787855986.825804:0:15042:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787855986.826031:0:15042:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787855986.827459:0:15042:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787855986.831721:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 321: rc = 0 00100000:10000000:2.0:1787855986.832339:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 321: rc = 0 00100000:10000000:2.0:1787855986.833289:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 321: rc = 0 00100000:10000000:2.0:1787855986.833747:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 466: rc = 0 00100000:10000000:2.0:1787855986.836501:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 466: rc = 0 00100000:10000000:2.0:1787855986.836766:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 466: rc = 0 00100000:10000000:2.0:1787855986.837021:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 466: rc = 0 00100000:10000000:2.0:1787855986.840411:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 466: rc = 0 00100000:10000000:2.0:1787855986.840700:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 466: rc = 0 00000020:00000080:2.0:1787855986.846399:0:15042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787855986.846413:0:15042:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787855986.846426:0:15042:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x516929ca3366e70f 00000020:01000004:2.0:1787855986.846435:0:15042:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787855986.846456:0:15042:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.138@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787855986.846459:0:15042:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787855986.846465:0:15042:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787855986.846470:0:15042:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787855986.846482:0:15042:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a74004cb3a0) 00000020:00000080:2.0:1787855986.846493:0:15042:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787855986.857439:0:15042:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787855986.857634:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787855986.857640:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787855986.862053:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787855986.862081:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787855986.862983:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787855986.862991:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787855986.866187:0:15042:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787855986.866391:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787855986.866398:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787855986.877194:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787855986.877215:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787855986.899841:0:15042:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787855986.900636:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787855986.900642:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787855986.905401:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787855986.905423:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787855986.910337:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787855986.910360:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787855986.913606:0:15042:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787855986.913849:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787855986.913856:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787855986.919964:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787855986.919981:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787855987.035773:0:15042:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787855987.036821:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787855987.036831:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787855987.052713:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787855987.052735:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787855987.056092:0:15042:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787855987.056120:0:15042:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787855987.056125:0:15042:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787855987.074074:0:15042:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787855987.074108:0:15042:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.138@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787855987.074112:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787855987.074114:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787855987.074115:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787855987.074117:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787855987.074118:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787855987.074119:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787855987.074121:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787855987.074123:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787855987.074124:0:15042:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787855987.074128:0:15042:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787855987.074130:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787855987.074131:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787855987.074133:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787855987.074134:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787855987.074135:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787855987.074136:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787855987.074137:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787855987.074138:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787855987.074139:0:15042:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787855987.074162:0:15042:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787855987.074183:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486300928:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787855987.074247:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855987.074301:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d08aa840 going to sleep for 11 seconds 00000100:00100000:3.0:1787855987.074323:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486300928 00000100:00100000:3.0:1787855987.074331:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486300928 00000100:00100000:3.0:1787855987.074401:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787855987.074412:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c600bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+12:15042:x1874702486300928:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787855987.074442:0:14354:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787855987.074446:0:14354:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787855987.074450:0:14354:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787855987.095660:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c600bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+12:15042:x1874702486300928:12345-0@lo:253:mount.lustre.0 Request processed in 21241us (21403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855987.095675:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787855987.096064:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486300928:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787855987.096095:0:15042:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787855987.096098:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787855987.096100:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787855987.096101:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787855987.096102:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787855987.096104:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787855987.096105:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787855987.096106:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787855987.096107:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787855987.096109:0:15042:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787855987.096126:0:15042:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a73d8173000 from lustre-OST0000 10000000:01000000:0.0:1787855987.096155:0:15042:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787855987.096157:0:15042:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787855987.096164:0:15042:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a72c2bd4d70 local copy 00010000:00010000:0.0:1787855987.096175:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ff800/0x516929ca3366e605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e60c expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855987.096402:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486301056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787855987.096441:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855987.096486:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d08aa9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787855987.096530:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486301056 00000100:00100000:3.0:1787855987.096536:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486301056 00000100:00100000:3.0:1787855987.096580:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787855987.096588:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c6009c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+12:15042:x1874702486301056:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787855987.096744:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c6009c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+12:15042:x1874702486301056:12345-0@lo:501:mount.lustre.0 Request processed in 156us (301us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787855987.096752:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787855987.096859:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486301056:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787855987.096872:0:15042:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787855987.097315:0:15042:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787855987.097323:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ff800/0x516929ca3366e605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e60c expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855987.097333:0:15042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ff800/0x516929ca3366e605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e60c expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855987.097369:0:15042:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a73d8173000 10000000:01000000:0.0:1787855987.097380:0:15042:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787855987.097385:0:15042:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a72c2bd4d70 10000000:01000000:0.0:1787855987.097388:0:15042:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787855987.097391:0:15042:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a72c2bd4d70 from 1 10000000:01000000:0.0:1787855987.097394:0:15042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787855987.097421:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e71d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855987.097429:0:15042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e71d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855987.097439:0:15042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e71d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855987.097454:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486301184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787855987.097488:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855987.097581:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d08aa9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787855987.104056:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486301184 00000100:00100000:3.0:1787855987.104069:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486301184 00000100:00100000:3.0:1787855987.104136:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787855987.104146:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c600a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+12:15042:x1874702486301184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787855987.104162:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855987.104179:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c166c400/0x516929ca3366e724 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e71d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855987.104218:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c166c400/0x516929ca3366e724 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e71d expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855987.104230:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c166c400/0x516929ca3366e724 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e71d expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855987.104240:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166c400, rc 0) 00000100:00100000:3.0:1787855987.104314:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c600a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+13:15042:x1874702486301184:12345-0@lo:101:mount.lustre.0 Request processed in 170us (6825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855987.104321:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787855987.104597:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486301184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787855987.104617:0:15042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e71d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e724 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855987.104626:0:15042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e71d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e724 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855987.104646:0:15042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787855987.104666:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e71d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e724 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855987.104674:0:15042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c5143e00/0x516929ca3366e71d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e724 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855987.104697:0:15042:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787855987.104701:0:15042:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787855987.104707:0:15042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787855987.104709:0:15042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787855987.104732:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5142a00/0x516929ca3366e72b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855987.104740:0:15042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c5142a00/0x516929ca3366e72b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855987.104750:0:15042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c5142a00/0x516929ca3366e72b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855987.104769:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486301312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787855987.105209:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855987.105246:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d08aa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855987.105309:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486301312 00000100:00100000:2.0:1787855987.105315:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486301312 00000100:00100000:2.0:1787855987.105366:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787855987.105383:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c6009450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+13:15042:x1874702486301312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787855987.105392:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855987.105404:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73f7887200/0x516929ca3366e732 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e72b expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855987.105420:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73f7887200/0x516929ca3366e732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e72b expref: 14 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855987.105429:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73f7887200/0x516929ca3366e732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e72b expref: 14 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855987.105436:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887200, rc 0) 00000100:00100000:2.0:1787855987.105484:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c6009450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+14:15042:x1874702486301312:12345-0@lo:101:mount.lustre.0 Request processed in 103us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855987.105491:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787855987.105625:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486301312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787855987.105636:0:15042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c5142a00/0x516929ca3366e72b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e732 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855987.105644:0:15042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c5142a00/0x516929ca3366e72b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e732 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787855987.106853:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787855987.127486:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787855987.127834:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787855987.127881:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787855987.127934:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787855987.127985:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787855987.128025:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787855987.128057:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787855987.128119:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787855987.128128:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787855987.128215:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486301440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787855987.128282:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855987.128335:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787855987.128408:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486301440 00000100:00100000:3.0:1787855987.128416:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486301440 00000100:00100000:3.0:1787855987.128454:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787855987.128462:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c600b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+14:15042:x1874702486301440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787855987.128757:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c600b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+14:15042:x1874702486301440:12345-0@lo:501:mount.lustre.0 Request processed in 294us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855987.128765:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787855987.129550:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486301440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787855987.129594:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486301568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787855987.129647:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855987.129683:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73e743a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787855987.131563:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486301568 00000100:00100000:3.0:1787855987.131577:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486301568 00000100:00100000:3.0:1787855987.131644:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787855987.131654:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c600a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+14:15042:x1874702486301568:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787855987.133018:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c600a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+14:15042:x1874702486301568:12345-0@lo:503:mount.lustre.0 Request processed in 1359us (3363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855987.133029:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787855987.134030:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486301568:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787855987.134958:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787855987.135039:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486301696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787855987.135120:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855987.135170:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bd780 going to sleep for 11 seconds 00000100:00100000:3.0:1787855987.136211:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486301696 00000100:00100000:3.0:1787855987.136220:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486301696 00000100:00100000:3.0:1787855987.136291:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787855987.136302:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c6009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+14:15042:x1874702486301696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787855987.136588:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c6009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+14:15042:x1874702486301696:12345-0@lo:502:mount.lustre.0 Request processed in 288us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855987.136596:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787855987.137581:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486301696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787855987.139030:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787855987.139271:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787855987.139313:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787855987.139379:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787855987.139420:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787855987.139618:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787855987.139691:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787855987.139734:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787855987.139812:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787855987.139865:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787855987.139895:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787855987.139936:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787855987.140298:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486301824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787855987.140387:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855987.140440:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bd780 going to sleep for 11 seconds 00000100:00100000:3.0:1787855987.142004:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486301824 00000100:00100000:3.0:1787855987.142016:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486301824 00000100:00100000:3.0:1787855987.142559:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787855987.142571:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c6009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+14:15042:x1874702486301824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787855987.150529:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c6009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+14:15042:x1874702486301824:12345-0@lo:502:mount.lustre.0 Request processed in 7952us (10135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855987.150544:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787855987.152605:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486301824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787855987.152754:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787855987.152769:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787855987.156115:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787855987.156128:0:15056:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787855987.156135:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787855987.156137:0:15056:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787855987.156143:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787855987.156159:0:15056:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a73d06e4d70) 00000020:00000080:3.0:1787855987.156181:0:15056:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787855987.156188:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787855987.156247:0:15056:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a73d8173000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787855987.156256:0:15056:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787855987.156264:0:15056:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x516929ca3366e740 00010000:00010000:2.0:1787855987.172963:0:15056:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787855987.173839:0:15056:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787855987.182745:0:15056:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787855987.195965:0:15056:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787855987.195978:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787855987.195984:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787855987.195986:0:15056:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787855987.195989:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787855987.195992:0:15056:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1787855987.195994:0:15056:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787855987.195995:0:15056:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787855987.196008:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787855987.196011:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787855987.196013:0:15056:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787855987.196016:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787855987.196019:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787855987.196020:0:15056:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787855987.196023:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787855987.196025:0:15056:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787855987.196028:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787855987.196030:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787855987.196031:0:15056:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787855987.196033:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787855987.196035:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787855987.196037:0:15056:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787855987.196040:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787855987.196113:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787855987.196117:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787855987.196119:0:15056:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787855987.196122:0:15056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1787855987.198561:0:15042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787855987.198599:0:15042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787855987.198628:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5142a00/0x516929ca3366e72b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e732 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855987.198650:0:15042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c5142a00/0x516929ca3366e72b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e732 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787855987.198659:0:15042:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73d8173000 from 1 10000000:01000000:0.0:1787855987.198662:0:15042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787855987.198701:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143c00/0x516929ca3366e747 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855987.198709:0:15042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c5143c00/0x516929ca3366e747 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855987.198721:0:15042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c5143c00/0x516929ca3366e747 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855987.198746:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486301952:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787855987.198833:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855987.198883:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d08aa180 going to sleep for 11 seconds 00000100:00100000:2.0:1787855987.200984:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486301952 00000100:00100000:2.0:1787855987.200997:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486301952 00000100:00100000:2.0:1787855987.201057:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787855987.201067:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c6008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+14:15042:x1874702486301952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787855987.201085:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855987.201113:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73f7887c00/0x516929ca3366e74e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e747 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855987.201143:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73f7887c00/0x516929ca3366e74e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e747 expref: 15 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855987.201155:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73f7887c00/0x516929ca3366e74e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e747 expref: 15 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855987.201176:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7887c00, rc 0) 00000100:00100000:2.0:1787855987.201250:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c6008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+15:15042:x1874702486301952:12345-0@lo:101:mount.lustre.0 Request processed in 184us (2417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855987.201256:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787855987.202002:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486301952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787855987.202023:0:15042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c5143c00/0x516929ca3366e747 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e74e expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855987.202034:0:15042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c5143c00/0x516929ca3366e747 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e74e expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787855987.202561:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787855987.210668:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787855987.212644:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787855987.212711:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787855987.213000:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787855987.213012:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787855987.213624:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486302080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787855987.213692:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855987.213796:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bd000 going to sleep for 11 seconds 00000100:00100000:3.0:1787855987.227282:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486302080 00000100:00100000:3.0:1787855987.227298:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486302080 00000100:00100000:3.0:1787855987.227367:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787855987.227379:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+15:15042:x1874702486302080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787855987.227700:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+15:15042:x1874702486302080:12345-0@lo:501:mount.lustre.0 Request processed in 323us (14007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855987.227715:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787855987.227831:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486302080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787855987.227900:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486302208:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787855987.227947:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855987.227989:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bd000 going to sleep for 11 seconds 00000100:00100000:0.0:1787855987.228143:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486302208 00000100:00100000:0.0:1787855987.228148:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486302208 00000100:00100000:0.0:1787855987.228173:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787855987.228187:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+15:15042:x1874702486302208:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787855987.228324:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+15:15042:x1874702486302208:12345-0@lo:503:mount.lustre.0 Request processed in 137us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855987.228330:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787855987.228537:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486302208:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787855987.229037:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787855987.229108:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486302336:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787855987.229154:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855987.229177:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bd000 going to sleep for 11 seconds 00000100:00100000:0.0:1787855987.229306:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486302336 00000100:00100000:0.0:1787855987.229311:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486302336 00000100:00100000:0.0:1787855987.229358:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787855987.229365:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+15:15042:x1874702486302336:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787855987.229528:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+15:15042:x1874702486302336:12345-0@lo:502:mount.lustre.0 Request processed in 163us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855987.229536:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787855987.231511:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486302336:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787855987.231881:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787855987.231939:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787855987.231982:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787855987.232015:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787855987.232066:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787855987.232126:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787855987.232156:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787855987.232181:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787855987.232218:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486302464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787855987.232282:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855987.232319:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bd000 going to sleep for 11 seconds 00000100:00100000:0.0:1787855987.232704:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486302464 00000100:00100000:0.0:1787855987.232712:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486302464 00000100:00100000:0.0:1787855987.232766:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787855987.232795:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+15:15042:x1874702486302464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787855987.233015:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+15:15042:x1874702486302464:12345-0@lo:502:mount.lustre.0 Request processed in 239us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855987.233023:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787855987.233616:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486302464:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787855987.233734:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787855987.233748:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787855987.240763:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787855987.240813:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855987.240817:0:15060:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787855987.240825:0:15060:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a73d8173000 00000020:00000080:0.0:1787855987.240828:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787855987.240835:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787855987.240838:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855987.240839:0:15060:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787855987.240841:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787855987.240843:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855987.240856:0:15060:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787855987.240873:0:15060:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a73d8173000 00000020:00000080:0.0:1787855987.240875:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787855987.240929:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787855987.240932:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855987.240934:0:15060:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787855987.240936:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787855987.240938:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855987.240939:0:15060:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787855987.240942:0:15060:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a73d8173000 00000020:00000080:0.0:1787855987.240945:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787855987.240979:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787855987.240982:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787855987.240984:0:15060:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787855987.240987:0:15060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787855987.241234:0:15042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787855987.241259:0:15042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787855987.241274:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c5143c00/0x516929ca3366e747 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e74e expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855987.241285:0:15042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c5143c00/0x516929ca3366e747 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e74e expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855987.241323:0:15042:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787855987.241326:0:15042:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a73d8173000 10000000:01000000:2.0:1787855987.241329:0:15042:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a73d8173000 10000000:01000000:2.0:1787855987.241333:0:15042:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787855987.241338:0:15042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a73d8173000 from 1 10000000:01000000:2.0:1787855987.241340:0:15042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787855987.241387:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73f7887400/0x516929ca3366e755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855987.241396:0:15042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73f7887400/0x516929ca3366e755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855987.241407:0:15042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73f7887400/0x516929ca3366e755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855987.241430:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6770c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486302592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787855987.241641:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855987.242642:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c9171300 going to sleep for 11 seconds 00000100:00100000:3.0:1787855987.258693:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486302592 00000100:00100000:3.0:1787855987.258708:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486302592 00000100:00100000:3.0:1787855987.258770:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787855987.258807:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+15:15042:x1874702486302592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787855987.258823:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787855987.258841:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c166d000/0x516929ca3366e75c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e755 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855987.258872:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c166d000/0x516929ca3366e75c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e755 expref: 16 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855987.258883:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c166d000/0x516929ca3366e75c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e755 expref: 16 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855987.258892:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c166d000, rc 0) 00000100:00100000:3.0:1787855987.258967:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+16:15042:x1874702486302592:12345-0@lo:101:mount.lustre.0 Request processed in 164us (17327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855987.258973:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787855987.266136:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6770c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486302592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787855987.266166:0:15042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73f7887400/0x516929ca3366e755 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e75c expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855987.266179:0:15042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73f7887400/0x516929ca3366e755 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e75c expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787855987.267865:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787855987.268196:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787855987.268505:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787855987.268549:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787855987.268584:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787855987.268630:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787855987.268667:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787855987.268718:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787855987.268755:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787855987.268817:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787855987.268867:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787855987.268903:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787855987.268956:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787855987.269009:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787855987.269045:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787855987.269080:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787855987.269127:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787855987.269162:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787855987.269194:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787855987.269241:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787855987.269276:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787855987.269308:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787855987.269378:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787855987.269415:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787855987.269449:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787855987.269512:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787855987.269551:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787855987.269586:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787855987.269653:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787855987.269693:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787855987.269770:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787855987.269802:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787855987.269894:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6770c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486302720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787855987.269961:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855987.270008:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c9171300 going to sleep for 11 seconds 00000100:00100000:1.0:1787855987.270512:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486302720 00000100:00100000:1.0:1787855987.270520:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486302720 00000100:00100000:1.0:1787855987.270577:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787855987.270588:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+16:15042:x1874702486302720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787855987.270849:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+16:15042:x1874702486302720:12345-0@lo:501:mount.lustre.0 Request processed in 262us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855987.270863:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787855987.270880:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6770c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486302720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787855987.270917:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486302848:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787855987.270957:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855987.270986:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d08aa240 going to sleep for 11 seconds 00000100:00100000:1.0:1787855987.271041:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486302848 00000100:00100000:1.0:1787855987.271046:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486302848 00000100:00100000:1.0:1787855987.271076:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787855987.271083:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+16:15042:x1874702486302848:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787855987.271211:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+16:15042:x1874702486302848:12345-0@lo:503:mount.lustre.0 Request processed in 128us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855987.271218:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787855987.271287:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486302848:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787855987.271972:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787855987.272045:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486302976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787855987.272088:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787855987.272109:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d08aa240 going to sleep for 11 seconds 00000100:00100000:0.0:1787855987.272129:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486302976 00000100:00100000:0.0:1787855987.272133:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486302976 00000100:00100000:0.0:1787855987.272160:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787855987.272168:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+16:15042:x1874702486302976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787855987.272339:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+16:15042:x1874702486302976:12345-0@lo:502:mount.lustre.0 Request processed in 170us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855987.272362:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787855987.272410:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486302976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787855987.272627:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787855987.272670:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787855987.272700:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787855987.272744:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787855987.272803:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787855987.272864:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787855987.272901:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787855987.272932:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787855987.272977:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787855987.273011:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787855987.273044:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787855987.273089:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787855987.273125:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787855987.273156:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787855987.273202:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787855987.273250:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787855987.273284:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787855987.273332:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787855987.273379:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787855987.273413:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787855987.273459:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787855987.273493:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787855987.273522:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787855987.273566:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787855987.273599:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787855987.273627:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787855987.273669:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787855987.273702:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787855987.273748:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787855987.273837:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787855987.273876:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787855987.273925:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787855987.273959:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787855987.274006:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787855987.274040:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787855987.274087:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787855987.274123:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787855987.274155:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787855987.274202:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787855987.274236:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787855987.274278:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486303104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787855987.280592:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855987.280742:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486303104 00000100:00100000:1.0:1787855987.280752:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486303104 00000100:00100000:1.0:1787855987.280829:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787855987.280839:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+16:15042:x1874702486303104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787855987.281120:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+16:15042:x1874702486303104:12345-0@lo:502:mount.lustre.0 Request processed in 281us (6777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855987.281128:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787855987.281181:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d08aa240 going to sleep for 11 seconds 00000100:00100000:1.0:1787855987.281206:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486303104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787855987.281314:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787855987.281331:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787855987.284901:0:15065:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787855987.284920:0:15065:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a73c50e4d70) 00000020:00000080:0.0:1787855987.284942:0:15065:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787855987.285028:0:15065:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a73d8173000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787855987.285033:0:15065:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a73d8173000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787855987.285035:0:15065:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a73d8173000 3 00010000:00080000:0.0:1787855987.285072:0:15065:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a73cc3c4000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.138@tcp at head 00010000:00010000:0.0:1787855987.291939:0:15065:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787855987.292114:0:15065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787855987.292151:0:15065:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787855987.292166:0:15065:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x516929ca3366e76a 00000100:00080000:0.0:1787855987.292177:0:15065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787855987.292183:0:15065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a73cc3c4000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:0.0:1787855987.292216:0:15065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a72c2e08b40 x1874702486303232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787855987.292247:0:15065:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787855987.292278:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787855987.292282:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787855987.292284:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787855987.292287:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787855987.292334:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486303360:0@lo:400:kworker.0 00000100:00100000:0.0:1787855987.292407:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855987.293601:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486303360 00000100:00100000:1.0:1787855987.293611:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486303360 00000100:00100000:1.0:1787855987.293655:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787855987.293663:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486303360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855987.293731:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486303360:12345-0@lo:400:kworker.0 Request processed in 69us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855987.293738:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787855987.293815:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a72c2e0b480 x1874702486303360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855987.293830:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486303360:0@lo:400:kworker.0 00000100:00100000:2.0:1787855987.299265:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874702486303232:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787855987.299351:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855987.299421:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486303232 00000100:00100000:2.0:1787855987.299428:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486303232 00000100:00100000:2.0:1787855987.299577:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787855987.299585:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb675680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874702486303232:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787855987.299611:0:14360:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:2.0:1787855987.299654:0:14360:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x516929ca3366e771 00000004:00100000:2.0:1787855987.299669:0:14360:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787855987.299702:0:14360:0:(import.c:65:import_set_state_nolock()) ffff9a7400486000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787855987.299753:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb675680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874702486303232:12345-0@lo:38:llog_process_th.0 Request processed in 167us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855987.299761:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787855987.307622:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a72c2e08b40 x1874702486303232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787855997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855987.307650:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787855987.307663:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787855987.307673:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787855987.307678:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787855987.307682:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73cc3c4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787855987.307688:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874702486303232:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787855987.308069:0:15065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787855987.308122:0:15042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787855987.308151:0:15042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787855987.308173:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73f7887400/0x516929ca3366e755 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e75c expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855987.308184:0:15042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73f7887400/0x516929ca3366e755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e75c expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787855987.308229:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787855987.308231:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787855987.308232:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787855987.308233:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787855987.308235:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787855987.308236:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787855987.308238:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787855987.308240:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787855987.308242:0:15042:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787855987.308246:0:15042:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787855987.308249:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787855987.308250:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787855987.308252:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787855987.308253:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787855987.308254:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787855987.308255:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787855987.308256:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787855987.308257:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787855987.308258:0:15042:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787855987.308280:0:15042:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787855987.308296:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486303488:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787855987.308375:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855987.308418:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bd840 going to sleep for 11 seconds 00000100:00100000:1.0:1787855987.308437:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486303488 00000100:00100000:1.0:1787855987.309108:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486303488 00000100:00100000:1.0:1787855987.309197:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787855987.309206:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+16:15042:x1874702486303488:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787855987.309235:0:14354:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787855987.309249:0:14354:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787855987.368882:0:14354:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787855987.368901:0:14354:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787855987.368933:0:14376:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787855987.368938:0:14376:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787855987.368964:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a73f7887000/0x516929ca3366e778 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855987.368985:0:14376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73fa6ff600/0x516929ca3366e6e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e6de expref: 16 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855987.368993:0:14376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a73f7887000/0x516929ca3366e778 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855987.369039:0:14376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73fa6ff600/0x516929ca3366e6e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366e6de expref: 16 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855987.369053:0:14376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a73fa6ff600/0x516929ca3366e6e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366e6de expref: 16 pid: 14354 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787855987.369069:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb675a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14376:1874702486303616:0@lo:104: 00000100:00100000:2.0:1787855987.369134:0:14376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855987.369184:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787855987.369289:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486303616 00000100:00100000:0.0:1787855987.369297:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486303616 00000100:00100000:0.0:1787855987.369353:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787855987.369363:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb677c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff37be87-90a7-463b-b734-d2f25b77f044+3:14376:x1874702486303616:12345-0@lo:104: 00010000:00010000:0.0:1787855987.369381:0:14344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73c5143400/0x516929ca3366e6de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366e6e5 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855987.369582:0:14344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787855987.369590:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb677c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff37be87-90a7-463b-b734-d2f25b77f044+3:14376:x1874702486303616:12345-0@lo:104: Request processed in 228us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855987.369597:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787855987.369637:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb675a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14376:1874702486303616:0@lo:104: 00010000:00010000:0.0:1787855987.369656:0:14376:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a73f7887000/0x516929ca3366e778 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787855987.376309:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+16:15042:x1874702486303488:12345-0@lo:253:mount.lustre.0 Request processed in 67094us (67924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787855987.376324:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787855987.376483:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15042:1874702486303488:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787855987.376498:0:15042:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787855987.376502:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787855987.376504:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787855987.376505:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787855987.376506:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787855987.376507:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787855987.376509:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787855987.376510:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787855987.376512:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787855987.376514:0:15042:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787855987.376530:0:15042:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787855987.378948:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855987.378961:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c5143400/0x516929ca3366e6de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366e6e5 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855987.378988:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143400 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:2.0:1787855987.378993:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5143400/0x516929ca3366e6de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366e6e5 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855987.379004:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c5143400/0x516929ca3366e6de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366e6e5 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787855987.379012:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5143400/0x516929ca3366e6de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366e6e5 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787855987.379018:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787855987.381302:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c5143400/0x516929ca3366e6de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e6e5 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855987.381316:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787855987.381352:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c5143400/0x516929ca3366e6de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e6e5 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855987.381360:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c5143400/0x516929ca3366e6de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e6e5 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855987.381410:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787855987.381428:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff37be87-90a7-463b-b734-d2f25b77f044:3305:1874702486303744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787855987.381505:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787855987.381553:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855987.381555:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855987.381557:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787855987.382650:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486303744 00000100:00100000:1.0:1787855987.382660:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486303744 00010000:00010000:1.0:1787855987.382691:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73fa6ff600/0x516929ca3366e6e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366e6de expref: 16 pid: 14354 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855987.382724:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787855987.382733:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff37be87-90a7-463b-b734-d2f25b77f044+16:3305:x1874702486303744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787855987.382746:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787855987.382751:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73fa6ff600/0x516929ca3366e6e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366e6de expref: 16 pid: 14354 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855987.382762:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73fa6ff600/0x516929ca3366e6e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366e6de expref: 16 pid: 14354 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855987.382804:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73fa6ff600/0x516929ca3366e6e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366e6de expref: 16 pid: 14354 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855987.382820:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a73f7887000/0x516929ca3366e778 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855987.382829:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73f7887000/0x516929ca3366e778 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787855987.382846:0:14346:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013909198s 00010000:00010000:1.0:1787855987.382851:0:14346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73f7887000/0x516929ca3366e778 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855987.382869:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73f7887000/0x516929ca3366e778 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855987.382877:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a73f7887000/0x516929ca3366e778 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855987.382883:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a73f7887000/0x516929ca3366e778 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855987.382890:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787855987.382894:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a73f7887000/0x516929ca3366e778 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855987.382902:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a73f7887000/0x516929ca3366e778 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855987.382919:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a73f7887000/0x516929ca3366e778 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855987.382937:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787855987.382995:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff37be87-90a7-463b-b734-d2f25b77f044+15:3305:x1874702486303744:12345-0@lo:103:ldlm_bl.0 Request processed in 263us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855987.383003:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787855987.383031:0:14376:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a73f7887000/0x516929ca3366e778 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855987.383039:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a73f7887000/0x516929ca3366e778 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855987.383045:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73f7887000/0x516929ca3366e778 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855987.383081:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff37be87-90a7-463b-b734-d2f25b77f044:3305:1874702486303744:0@lo:103:ldlm_bl.0 00080000:10000000:0.0:1787855987.384552:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855987.384718:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787855987.385644:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855987.386216:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787855987.386399:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787855987.386746:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787855987.392596:0:15042:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787855987.475738:0:15042:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787855987.475747:0:15042:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787855987.475810:0:15042:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787855987.475867:0:15042:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787855987.475883:0:15042:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787855987.475912:0:15042:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787855987.585582:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855988.606887:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787855989.181561:0:14357:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787855989.181569:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a73f9d8a000 from 7 10000000:01000000:1.0:1787855989.181574:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787855989.181621:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e77f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855989.181633:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e77f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855989.181661:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e77f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787855989.181686:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df849680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486303872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787855989.181754:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855989.181828:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855989.181906:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486303872 00000100:00100000:2.0:1787855989.181914:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486303872 00000100:00100000:2.0:1787855989.181966:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787855989.181976:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+15:14357:x1874702486303872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787855989.181989:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787855989.182002:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73f7886e00/0x516929ca3366e786 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e77f expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855989.182023:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73f7886e00/0x516929ca3366e786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e77f expref: 16 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855989.182034:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73f7886e00/0x516929ca3366e786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e77f expref: 16 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855989.182044:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73f7886e00, rc 0) 00000100:00100000:2.0:1787855989.182092:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+16:14357:x1874702486303872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855989.182109:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787855989.182210:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df849680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486303872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787855989.182225:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e77f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e786 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855989.182234:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e77f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e786 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787855989.182288:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7648b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486304000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787855989.182332:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855989.182358:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50cccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787855989.182488:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486304000 00000100:00100000:2.0:1787855989.182493:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486304000 00000100:00100000:2.0:1787855989.182521:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787855989.182528:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+16:14357:x1874702486304000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787855989.182540:0:14354:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787855989.182555:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787855989.182558:0:14354:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787855989.182638:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+16:14357:x1874702486304000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855989.182658:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787855989.182691:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7648b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486304000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787855989.182747:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787855989.182754:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e77f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e786 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855989.182763:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e77f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e786 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855989.628175:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855990.652162:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855991.677163:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787855992.444287:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787855992.444298:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787855992.444301:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787855992.444305:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787855992.444397:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff37be87-90a7-463b-b734-d2f25b77f044:3305:1874702486304128:0@lo:400:kworker.0 00000100:00100000:3.0:1787855992.444498:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855992.444807:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7648780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486304256:0@lo:400:kworker.0 00000100:00100000:3.0:1787855992.444883:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855992.444910:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787855992.444917:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486304384:0@lo:400:kworker.0 00000100:00100000:3.0:1787855992.444943:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787855992.444978:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486304256 00000100:00100000:3.0:1787855992.445087:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486304256 00000100:00100000:3.0:1787855992.445159:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486304384 00000100:00100000:3.0:1787855992.445163:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486304384 00000100:00100000:3.0:1787855992.445192:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787855992.445201:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486304256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855992.445274:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486304256:12345-0@lo:400:kworker.0 Request processed in 73us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855992.445282:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787855992.445301:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787855992.445307:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7648f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486304384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787855992.445333:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7648f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486304384:12345-0@lo:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787855992.445339:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787855992.445420:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73f764a1c0 x1874702486304384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855992.445435:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486304384:0@lo:400:kworker.0 00010000:00080000:3.0:1787855992.445444:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73f7648780 x1874702486304256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855992.445451:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7648780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486304256:0@lo:400:kworker.0 00000100:00100000:2.0:1787855992.445870:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486304128 00000100:00100000:2.0:1787855992.445876:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486304128 00000100:00100000:2.0:1787855992.445913:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787855992.445921:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+16:3305:x1874702486304128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787855992.445973:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+16:3305:x1874702486304128:12345-0@lo:400:kworker.0 Request processed in 53us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855992.445979:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1787855992.446062:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787855992.446687:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff37be87-90a7-463b-b734-d2f25b77f044:3305:1874702486304128:0@lo:400:kworker.0 00010000:00010000:0.0:1787855992.702810:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787855993.663146:0:15410:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787855993.737174:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787855994.172397:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787855994.761068:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855995.778172:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855996.797914:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787855997.566380:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787855982/real 1787855982] req@ffff9a73df8492c0 x1874702486300160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787855997 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855997.566420:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a73df8492c0 x1874702486300160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787855997 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855997.566431:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787855982/real 1787855982] req@ffff9a73df849e00 x1874702486300288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787855997 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787855997.566442:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a73df849e00 x1874702486300288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787855997 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787855997.566464:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73eb7f9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787855997.566473:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787855997.566476:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486300160:0@lo:8:kworker.0 00000100:00080000:3.0:1787855997.566482:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73fa532000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787855997.566486:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787855997.566489:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486300288:0@lo:8:kworker.0 00000100:00080000:1.0:1787855997.572343:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787855997.572351:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787855997.572356:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a73eb7f9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787855997.572366:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:1.0:1787855997.572373:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787855997.572381:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a73eb7f9800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1787855997.572410:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73df84b0c0 x1874702486304640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787855997.572429:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787855997.572432:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787855997.572434:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a73fa532000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787855997.572448:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:1.0:1787855997.572451:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787855997.572455:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a73fa532000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1787855997.572477:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73df848000 x1874702486304768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787855997.572536:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486304896:0@lo:400:kworker.0 00000100:00100000:1.0:1787855997.572635:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855997.572710:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787855997.572717:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff37be87-90a7-463b-b734-d2f25b77f044:3305:1874702486304512:0@lo:400:kworker.0 00000100:00100000:1.0:1787855997.572750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855997.572805:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df848f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486305024:0@lo:400:kworker.0 00000100:00100000:1.0:1787855997.572838:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855997.572876:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486304896 00000100:00100000:1.0:1787855997.572886:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486304896 00000100:00100000:1.0:1787855997.572938:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486305024 00000100:00100000:1.0:1787855997.572941:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486305024 00000100:00100000:1.0:1787855997.572973:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787855997.572982:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486304896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855997.573038:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486304896:12345-0@lo:400:kworker.0 Request processed in 57us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855997.573046:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787855997.573070:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787855997.573076:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486305024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855997.573108:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486305024:12345-0@lo:400:kworker.0 Request processed in 32us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855997.573114:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787855997.573361:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486304512 00000100:00100000:1.0:1787855997.573365:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486304512 00000100:00100000:1.0:1787855997.573396:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787855997.573403:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+16:3305:x1874702486304512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787855997.573447:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+16:3305:x1874702486304512:12345-0@lo:400:kworker.0 Request processed in 44us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855997.573453:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787855997.573486:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787855997.573532:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73df848f00 x1874702486305024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787855997.573554:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df848f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486305024:0@lo:400:kworker.0 00000100:00100000:1.0:1787855997.573582:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486304640:0@lo:8:kworker.0 00000100:00100000:1.0:1787855997.573673:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855997.573707:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486304768:0@lo:8:kworker.0 00000100:00100000:1.0:1787855997.573733:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855997.573817:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486304640 00000100:00100000:1.0:1787855997.573822:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486304640 00000100:00100000:1.0:1787855997.573841:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486304768 00000100:00100000:1.0:1787855997.573844:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486304768 00000100:00100000:1.0:1787855997.573853:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787855997.573858:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df848f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1874702486304640:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787855997.573956:0:15045:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:1.0:1787855997.573992:0:15045:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x516929ca3366e78d 00002000:00100000:1.0:1787855997.574009:0:15045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a73c617d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787855997.574014:0:15045:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787855997.574017:0:15045:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787855997.578258:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff37be87-90a7-463b-b734-d2f25b77f044:3305:1874702486304512:0@lo:400:kworker.0 00010000:00080000:0.0:1787855997.578322:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73df84a580 x1874702486304896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855997.578337:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486304896:0@lo:400:kworker.0 00002000:00080000:1.0:1787855997.580353:0:15045:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787855997.580409:0:15045:0:(import.c:65:import_set_state_nolock()) ffff9a73c617f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787855997.580549:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df848f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874702486304640:12345-0@lo:8:kworker.0 Request processed in 6685us (6870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787855997.580570:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787855997.580618:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787855997.580625:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df849e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1874702486304768:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787855997.580647:0:15045:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787855997.580683:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df849e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1874702486304768:12345-0@lo:8:kworker.0 Request processed in 58us (6949us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787855997.580690:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787855997.585733:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73df84b0c0 x1874702486304640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787856017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787855997.585752:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787855997.585766:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787855997.589172:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787855997.589188:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787855997.589194:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73eb7f9800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787855997.589240:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787855997.589250:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486304640:0@lo:8:kworker.0 00000004:00080000:2.0:1787855997.590237:0:14383:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787855997.590268:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb677840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14383:1874702486305280:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787855997.590342:0:14383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855997.590390:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bd600 going to sleep for 11 seconds 00000100:00100000:2.0:1787855997.590410:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb674b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486305152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787855997.590435:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787855997.590891:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486305152 00000100:00100000:2.0:1787855997.590898:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486305152 00000100:00100000:2.0:1787855997.590951:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787855997.590960:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874702486305152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787855997.590992:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787855997.591040:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874702486305152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855997.591061:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787855997.591082:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787855997.591108:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73cb674b40 x1874702486305152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787855997.591130:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb674b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486305152:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787855997.594633:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73fa532000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787855997.594648:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787855997.594653:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486304768:0@lo:8:kworker.0 00000004:00080000:1.0:1787855997.595446:0:14382:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787855997.597963:0:14382:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 488450183172ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787855997.601276:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486305280 00000100:00100000:0.0:1787855997.601291:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486305280 00000100:00100000:0.0:1787855997.601360:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787855997.601369:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb676940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14383:x1874702486305280:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787855997.614274:0:15044:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787855997.614286:0:15044:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787855997.614291:0:15044:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000001:00100000:0.0:1787855997.654370:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1787855997.657115:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.657143:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e794 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.657184:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.657190:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.657198:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.657220:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.657231:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.657239:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e794 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.657263:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787855997.658055:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787855997.658066:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e794 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.658077:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886c00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787855997.658082:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e794 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.658093:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e794 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.658117:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e794 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.658138:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e794 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.662115:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855997.662136:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855997.662140:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787855997.667122:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.667211:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0fff003/0x516929ca3366e79b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.667233:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.667239:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.667247:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0fff003/0x516929ca3366e79b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.667265:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0fff003/0x516929ca3366e79b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.667289:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0fff003/0x516929ca3366e79b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.667297:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0fff003/0x516929ca3366e79b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.667455:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787855997.668039:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.668047:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.668057:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.668061:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.668065:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.668076:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.668085:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.668093:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.668500:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787855997.668510:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0fff003/0x516929ca3366e79b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.668520:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787855997.668526:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0fff003/0x516929ca3366e79b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.668537:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0fff003/0x516929ca3366e79b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.668591:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0fff003/0x516929ca3366e79b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.668601:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0fff003/0x516929ca3366e79b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.668765:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787855997.668770:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.668801:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787855997.668804:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.669112:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.669498:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.669517:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855997.669519:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855997.669521:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855997.672299:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787855997.672325:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787855997.673932:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.673947:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.673967:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.673972:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.673979:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.673995:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.674006:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.674013:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.674705:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787855997.674717:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.674728:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886400 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787855997.674734:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.674746:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.674769:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.675011:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787855997.675018:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.676124:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.676132:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855997.677767:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.678923:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787855997.679384:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.679398:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d71e7874/0x516929ca3366e7b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.679422:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.679427:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.679436:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d71e7874/0x516929ca3366e7b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.679454:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d71e7874/0x516929ca3366e7b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.679466:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d71e7874/0x516929ca3366e7b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.679474:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d71e7874/0x516929ca3366e7b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.679498:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787855997.679514:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787855997.679519:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d71e7874/0x516929ca3366e7b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.679527:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887800 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:2.0:1787855997.679532:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d71e7874/0x516929ca3366e7b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.679553:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d71e7874/0x516929ca3366e7b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.680813:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d71e7874/0x516929ca3366e7b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.680832:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d71e7874/0x516929ca3366e7b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.680863:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855997.680865:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855997.680868:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787855997.682833:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.682850:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.682883:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.682889:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.682898:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.682915:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.682926:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.682940:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.682971:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787855997.683899:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855997.683912:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.683926:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887600 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855997.683931:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.683943:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.683972:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.683981:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.684005:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.684020:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.684022:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787855997.687449:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.687466:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d99d92/0x516929ca3366e7be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.687486:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.687491:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.687498:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018d99d92/0x516929ca3366e7be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.687513:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018d99d92/0x516929ca3366e7be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.687524:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018d99d92/0x516929ca3366e7be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.687531:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018d99d92/0x516929ca3366e7be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.687716:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787855997.689429:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787855997.690837:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.690852:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e7c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.690924:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855997.690940:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018d99d92/0x516929ca3366e7be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.690943:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.690957:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.690973:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e7c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.690975:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887a00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855997.690988:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d99d92/0x516929ca3366e7be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.691000:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e7c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.691004:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018d99d92/0x516929ca3366e7be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.691030:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e7c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.691041:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e7c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.691063:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787855997.691648:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018d99d92/0x516929ca3366e7be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.691661:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018d99d92/0x516929ca3366e7be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.691702:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855997.691707:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e7c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.691716:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886a00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855997.691721:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e7c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.691804:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e7c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.691819:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e7c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.691829:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000819ffc8d/0x516929ca3366e7c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.691856:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.691860:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.691863:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.691899:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787855997.693733:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.693752:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d444da5/0x516929ca3366e7cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.693770:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.693984:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.693993:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d444da5/0x516929ca3366e7cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.694010:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d444da5/0x516929ca3366e7cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.694039:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d444da5/0x516929ca3366e7cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.694047:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d444da5/0x516929ca3366e7cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.694075:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787855997.694130:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855997.694143:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d444da5/0x516929ca3366e7cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.694157:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886600 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855997.694170:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d444da5/0x516929ca3366e7cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.694181:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d444da5/0x516929ca3366e7cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.694204:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d444da5/0x516929ca3366e7cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.694236:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d444da5/0x516929ca3366e7cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.694260:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.694262:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.694264:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787855997.695730:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.695742:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.695760:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.695766:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.695796:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.695813:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.695823:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.695832:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.695878:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787855997.695927:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855997.695938:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.695950:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886400 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855997.695955:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.695967:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.695990:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.695999:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f99f8450/0x516929ca3366e7d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.696040:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.696043:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.696066:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787855997.696860:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.697380:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.697400:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.697405:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.697411:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.697425:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.697434:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.697442:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.697470:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787855997.697581:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855997.697593:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.697605:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855997.697609:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.697619:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.697636:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.697644:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000085aefa6/0x516929ca3366e7da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.697667:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.697669:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.697670:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787855997.699488:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.699500:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f4cbbf/0x516929ca3366e7e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.699518:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.699531:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.699538:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f4cbbf/0x516929ca3366e7e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.699553:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f4cbbf/0x516929ca3366e7e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.699575:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1f4cbbf/0x516929ca3366e7e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.699584:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f4cbbf/0x516929ca3366e7e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.699680:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787855997.699741:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855997.699755:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1f4cbbf/0x516929ca3366e7e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.699813:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886200 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855997.699819:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f4cbbf/0x516929ca3366e7e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.699855:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1f4cbbf/0x516929ca3366e7e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.699877:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1f4cbbf/0x516929ca3366e7e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.699886:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f4cbbf/0x516929ca3366e7e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.699914:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.699916:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.699917:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787855997.702403:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.702418:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.702437:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.702442:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.702449:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.702465:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.702477:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.702495:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.702523:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787855997.702611:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855997.702625:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.702638:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7887600 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855997.702643:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.702654:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.702674:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.702703:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065406330/0x516929ca3366e7e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.702741:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.702743:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.702745:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787855997.704531:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.704542:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e7ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.705032:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.705039:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.705047:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e7ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.705064:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e7ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.705074:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e7ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.705082:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e7ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.705107:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787855997.705560:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855997.705573:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e7ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.705586:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73f7886c00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855997.705591:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e7ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.705602:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e7ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.705622:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e7ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.705630:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3c5c86d/0x516929ca3366e7ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.705660:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.705662:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.705663:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787855997.707253:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.707391:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfd4f2c7/0x516929ca3366e7f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.707415:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.707420:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.707426:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfd4f2c7/0x516929ca3366e7f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.707441:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfd4f2c7/0x516929ca3366e7f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.707452:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfd4f2c7/0x516929ca3366e7f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.707459:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfd4f2c7/0x516929ca3366e7f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.707485:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787855997.707535:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855997.707550:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfd4f2c7/0x516929ca3366e7f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.707564:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855997.707569:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfd4f2c7/0x516929ca3366e7f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.707580:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfd4f2c7/0x516929ca3366e7f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.707598:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfd4f2c7/0x516929ca3366e7f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.707606:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfd4f2c7/0x516929ca3366e7f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.707631:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.707633:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.707635:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787855997.709242:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.709254:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ff4b4f4/0x516929ca3366e7fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.709272:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.709276:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.709283:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ff4b4f4/0x516929ca3366e7fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.709296:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ff4b4f4/0x516929ca3366e7fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.709542:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ff4b4f4/0x516929ca3366e7fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.709551:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ff4b4f4/0x516929ca3366e7fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.709715:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787855997.711790:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855997.711806:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ff4b4f4/0x516929ca3366e7fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.711821:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229800 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855997.711826:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ff4b4f4/0x516929ca3366e7fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.711862:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ff4b4f4/0x516929ca3366e7fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.711885:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ff4b4f4/0x516929ca3366e7fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.711894:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ff4b4f4/0x516929ca3366e7fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.711922:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.711924:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.711926:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787855997.713241:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.713256:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecd91bfc/0x516929ca3366e804 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.713283:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.713288:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.713298:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd91bfc/0x516929ca3366e804 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.713417:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecd91bfc/0x516929ca3366e804 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.713431:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecd91bfc/0x516929ca3366e804 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.713439:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd91bfc/0x516929ca3366e804 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.713474:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787855997.713519:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855997.713530:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecd91bfc/0x516929ca3366e804 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.713547:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228200 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855997.713552:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecd91bfc/0x516929ca3366e804 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.713563:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecd91bfc/0x516929ca3366e804 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.713580:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecd91bfc/0x516929ca3366e804 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.713604:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecd91bfc/0x516929ca3366e804 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.713626:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.713628:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.713629:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787855997.721080:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787855997.721099:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3a78ed7/0x516929ca3366e80b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.721685:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1787855997.721693:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855997.721702:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3a78ed7/0x516929ca3366e80b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.721721:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3a78ed7/0x516929ca3366e80b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.721733:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3a78ed7/0x516929ca3366e80b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.721741:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3a78ed7/0x516929ca3366e80b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.721805:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787855997.722037:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787855997.722046:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3a78ed7/0x516929ca3366e80b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.722056:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166d400 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787855997.722061:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3a78ed7/0x516929ca3366e80b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.722089:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3a78ed7/0x516929ca3366e80b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.722111:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3a78ed7/0x516929ca3366e80b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.722120:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3a78ed7/0x516929ca3366e80b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.722231:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855997.722233:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855997.722235:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787855997.729508:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.729526:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089ebea6a/0x516929ca3366e812 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.729547:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.729552:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.729560:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089ebea6a/0x516929ca3366e812 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.730220:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089ebea6a/0x516929ca3366e812 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.730233:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089ebea6a/0x516929ca3366e812 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.730242:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089ebea6a/0x516929ca3366e812 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.730376:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787855997.730432:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855997.730449:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089ebea6a/0x516929ca3366e812 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.730462:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228400 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855997.730468:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089ebea6a/0x516929ca3366e812 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.730481:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089ebea6a/0x516929ca3366e812 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.730520:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089ebea6a/0x516929ca3366e812 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.730529:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089ebea6a/0x516929ca3366e812 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.730563:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.730565:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.730567:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787855997.738513:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787855997.738534:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000803cf523/0x516929ca3366e819 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.738557:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1787855997.738724:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855997.738734:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000803cf523/0x516929ca3366e819 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.738752:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000803cf523/0x516929ca3366e819 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.738844:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000803cf523/0x516929ca3366e819 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.738851:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000803cf523/0x516929ca3366e819 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.739045:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787855997.740046:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787855997.740056:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abaf239f/0x516929ca3366e820 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.740070:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1787855997.740073:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855997.740079:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abaf239f/0x516929ca3366e820 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.740091:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abaf239f/0x516929ca3366e820 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.740099:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abaf239f/0x516929ca3366e820 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.740108:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abaf239f/0x516929ca3366e820 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.740756:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787855997.740767:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000803cf523/0x516929ca3366e819 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.740795:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166c800 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787855997.740801:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000803cf523/0x516929ca3366e819 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.740822:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000803cf523/0x516929ca3366e819 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.740845:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000803cf523/0x516929ca3366e819 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.740965:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000803cf523/0x516929ca3366e819 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.740991:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787855997.740995:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abaf239f/0x516929ca3366e820 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.741002:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166ca00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787855997.741005:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abaf239f/0x516929ca3366e820 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.741012:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abaf239f/0x516929ca3366e820 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.741022:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abaf239f/0x516929ca3366e820 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.741029:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855997.741031:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855997.741033:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855997.741207:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787855997.741213:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abaf239f/0x516929ca3366e820 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787855997.744545:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787855997.744574:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8c00522/0x516929ca3366e827 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.744656:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1787855997.744662:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855997.744672:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8c00522/0x516929ca3366e827 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.744690:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8c00522/0x516929ca3366e827 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.744702:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8c00522/0x516929ca3366e827 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.744709:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8c00522/0x516929ca3366e827 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.744742:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787855997.744766:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787855997.744799:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8c00522/0x516929ca3366e827 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.744815:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166c600 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855997.744821:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8c00522/0x516929ca3366e827 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.744832:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8c00522/0x516929ca3366e827 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.744857:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8c00522/0x516929ca3366e827 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.744864:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8c00522/0x516929ca3366e827 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.744894:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.744896:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787855997.744898:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787855997.745855:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787855997.746018:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855997.746109:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095dbc47e/0x516929ca3366e82e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.746141:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1787855997.746145:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855997.746151:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095dbc47e/0x516929ca3366e82e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.746172:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095dbc47e/0x516929ca3366e82e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.746183:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095dbc47e/0x516929ca3366e82e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.746191:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095dbc47e/0x516929ca3366e82e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.746270:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787855997.747484:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787855997.747498:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002de3b783/0x516929ca3366e835 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.747512:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1787855997.747516:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787855997.747522:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002de3b783/0x516929ca3366e835 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.747534:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002de3b783/0x516929ca3366e835 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.747554:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002de3b783/0x516929ca3366e835 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787855997.747578:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002de3b783/0x516929ca3366e835 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.748771:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787855997.748808:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095dbc47e/0x516929ca3366e82e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.748822:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166dc00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787855997.748827:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095dbc47e/0x516929ca3366e82e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.748857:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095dbc47e/0x516929ca3366e82e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.752024:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095dbc47e/0x516929ca3366e82e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787855997.752049:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095dbc47e/0x516929ca3366e82e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.752428:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787855997.752438:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002de3b783/0x516929ca3366e835 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.752448:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166c000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787855997.752475:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002de3b783/0x516929ca3366e835 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.752487:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002de3b783/0x516929ca3366e835 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.752503:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002de3b783/0x516929ca3366e835 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.752512:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855997.752514:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855997.752518:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787855997.754823:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787855997.754842:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002de3b783/0x516929ca3366e835 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787855997.756117:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.756139:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a484cc00/0x516929ca3366e83c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.756157:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.756179:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.756187:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a484cc00/0x516929ca3366e83c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.756204:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a484cc00/0x516929ca3366e83c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.756216:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a484cc00/0x516929ca3366e83c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.756225:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a484cc00/0x516929ca3366e83c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.760440:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787855997.760463:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a484cc00/0x516929ca3366e83c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.760480:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229a00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787855997.760486:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a484cc00/0x516929ca3366e83c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.760499:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a484cc00/0x516929ca3366e83c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.760526:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a484cc00/0x516929ca3366e83c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.760538:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855997.762751:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855997.762755:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855997.763139:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787855997.763155:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a484cc00/0x516929ca3366e83c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787855997.768485:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.768503:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003612d9c5/0x516929ca3366e843 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.768524:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.768529:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.768537:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003612d9c5/0x516929ca3366e843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.768554:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003612d9c5/0x516929ca3366e843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.769050:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003612d9c5/0x516929ca3366e843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.769060:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003612d9c5/0x516929ca3366e843 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.771984:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787855997.772004:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003612d9c5/0x516929ca3366e843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.772021:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229400 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787855997.772027:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003612d9c5/0x516929ca3366e843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.772045:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003612d9c5/0x516929ca3366e843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.772073:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003612d9c5/0x516929ca3366e843 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.772088:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855997.772090:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855997.772092:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855997.773112:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787855997.773197:0:15044:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003612d9c5/0x516929ca3366e843 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.774242:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787855997.777484:0:15044:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787855997.777499:0:15044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8e6f625/0x516929ca3366e84a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.777520:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1787855997.777526:0:15044:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787855997.777533:0:15044:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8e6f625/0x516929ca3366e84a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.777549:0:15044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8e6f625/0x516929ca3366e84a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.777561:0:15044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8e6f625/0x516929ca3366e84a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.777582:0:15044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8e6f625/0x516929ca3366e84a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787855997.778276:0:15044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787855997.779275:0:15044:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:1.0:1787855997.779731:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787855997.779743:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8e6f625/0x516929ca3366e84a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.779757:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228c00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787855997.779762:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8e6f625/0x516929ca3366e84a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.779815:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8e6f625/0x516929ca3366e84a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.779843:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8e6f625/0x516929ca3366e84a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.779851:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8e6f625/0x516929ca3366e84a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787855997.779885:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855997.779887:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855997.779889:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787855997.780481:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb676940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14383:x1874702486305280:12345-0@lo:5:osp-pre-0-0.0 Request processed in 179105us (190131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787855997.780513:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787855997.784911:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb677840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14383:1874702486305280:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787855997.784940:0:14383:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1787855997.785012:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14383:1874702486305408:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787855997.785093:0:14383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787855997.785349:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486305408 00000100:00100000:1.0:1787855997.785358:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486305408 00000100:00100000:1.0:1787855997.785424:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787855997.785435:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f76492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14383:x1874702486305408:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787855997.785495:0:15045:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1787855997.788017:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80faa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787855997.810612:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f76492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14383:x1874702486305408:12345-0@lo:5:osp-pre-0-0.0 Request processed in 25163us (25503us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787855997.810631:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787855997.811414:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764bc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14383:1874702486305408:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787855997.811438:0:14383:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1787855997.820417:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787855998.844433:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787855999.872706:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856000.897801:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856001.918402:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787856002.255863:0:15762:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787856002.255869:0:15762:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787856002.257195:0:15762:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a72c1323800 00000020:01000004:2.0:1787856002.257220:0:15762:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787856002.257247:0:15762:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787856002.257268:0:15762:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a73c515b3a0) 00000020:00000080:2.0:1787856002.257290:0:15762:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787856002.300031:0:15762:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787856002.300404:0:15762:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787856002.301759:0:15762:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787856002.302217:0:15762:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787856002.302617:0:15762:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787856002.303128:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 419: rc = 0 00100000:10000000:3.0:1787856002.304331:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 419: rc = 0 00100000:10000000:3.0:1787856002.304689:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 419: rc = 0 00100000:10000000:3.0:1787856002.305458:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 487: rc = 0 00100000:10000000:3.0:1787856002.307165:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 487: rc = 0 00100000:10000000:3.0:1787856002.307662:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 487: rc = 0 00100000:10000000:3.0:1787856002.308224:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 487: rc = 0 00100000:10000000:3.0:1787856002.308657:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 487: rc = 0 00100000:10000000:3.0:1787856002.309025:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 487: rc = 0 00000020:00000080:3.0:1787856002.310197:0:15762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787856002.310213:0:15762:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787856002.310225:0:15762:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x516929ca3366e858 00000020:01000004:3.0:1787856002.310296:0:15762:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787856002.310325:0:15762:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.138@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787856002.310329:0:15762:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787856002.310336:0:15762:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787856002.310362:0:15762:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787856002.310366:0:15762:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.138@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787856002.325648:0:15762:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.138@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787856002.325702:0:15762:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.138@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787856002.325708:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787856002.325711:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787856002.325713:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787856002.325714:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787856002.325715:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787856002.325716:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787856002.325718:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787856002.325720:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787856002.325722:0:15762:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787856002.325727:0:15762:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787856002.325735:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787856002.325737:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787856002.325738:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787856002.325739:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787856002.325739:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787856002.325740:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787856002.325741:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787856002.325742:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787856002.325743:0:15762:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787856002.325872:0:15762:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787856002.325900:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486305536:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787856002.325992:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856002.326196:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856002.326346:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486305536 00000100:00100000:2.0:1787856002.326355:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486305536 00000100:00100000:2.0:1787856002.326464:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787856002.326477:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+16:15762:x1874702486305536:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787856002.326533:0:14353:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787856002.326537:0:14353:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1787856002.326541:0:14353:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787856002.338635:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+16:15762:x1874702486305536:12345-0@lo:253:mount.lustre.0 Request processed in 12146us (12628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856002.338655:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787856002.338843:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486305536:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787856002.338866:0:15762:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787856002.338870:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787856002.338872:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787856002.338873:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787856002.338875:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787856002.338876:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787856002.338877:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787856002.338879:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787856002.338882:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787856002.338884:0:15762:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787856002.338910:0:15762:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a72c1323800 from lustre-OST0001 10000000:01000000:3.0:1787856002.338950:0:15762:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787856002.338953:0:15762:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787856002.338963:0:15762:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a72c2bd4d70 local copy 00010000:00010000:3.0:1787856002.338977:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ff800/0x516929ca3366e605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e60c expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856002.339590:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486305664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787856002.339651:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856002.339763:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bd780 going to sleep for 11 seconds 00000100:00100000:1.0:1787856002.339937:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486305664 00000100:00100000:1.0:1787856002.339945:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486305664 00000100:00100000:1.0:1787856002.340099:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787856002.340112:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+16:15762:x1874702486305664:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856002.340443:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+16:15762:x1874702486305664:12345-0@lo:501:mount.lustre.0 Request processed in 333us (790us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787856002.340458:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787856002.340874:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486305664:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787856002.340896:0:15762:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787856002.341147:0:15762:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787856002.341157:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ff800/0x516929ca3366e605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e60c expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856002.341171:0:15762:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73fa6ff800/0x516929ca3366e605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e60c expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856002.341314:0:15762:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a72c1323800 10000000:01000000:3.0:1787856002.341321:0:15762:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787856002.341328:0:15762:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787856002.341331:0:15762:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787856002.341336:0:15762:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787856002.341340:0:15762:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787856002.341377:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166ca00/0x516929ca3366e85f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856002.341385:0:15762:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c166ca00/0x516929ca3366e85f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856002.341397:0:15762:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c166ca00/0x516929ca3366e85f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856002.341417:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486305792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787856002.341466:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856002.341561:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bd780 going to sleep for 11 seconds 00000100:00100000:2.0:1787856002.341609:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486305792 00000100:00100000:2.0:1787856002.341616:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486305792 00000100:00100000:2.0:1787856002.341670:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787856002.341688:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c54dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+16:15762:x1874702486305792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787856002.341702:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856002.341719:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73d1228600/0x516929ca3366e866 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e85f expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856002.341747:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1228600/0x516929ca3366e866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e85f expref: 17 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856002.341760:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73d1228600/0x516929ca3366e866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e85f expref: 17 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856002.341770:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228600, rc 0) 00000100:00100000:2.0:1787856002.341988:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c54dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+17:15762:x1874702486305792:12345-0@lo:101:mount.lustre.0 Request processed in 301us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856002.341996:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787856002.342150:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486305792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787856002.342165:0:15762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c166ca00/0x516929ca3366e85f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e866 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856002.342307:0:15762:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c166ca00/0x516929ca3366e85f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e866 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787856002.343310:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787856002.344403:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787856002.344679:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787856002.344722:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787856002.344749:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787856002.344846:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787856002.344886:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787856002.344922:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787856002.344989:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787856002.344998:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787856002.345110:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486305920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787856002.345198:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856002.345242:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787856002.345462:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486305920 00000100:00100000:1.0:1787856002.345471:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486305920 00000100:00100000:1.0:1787856002.345538:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787856002.345550:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+17:15762:x1874702486305920:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856002.345990:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+17:15762:x1874702486305920:12345-0@lo:501:mount.lustre.0 Request processed in 441us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856002.346012:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787856002.346382:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486305920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787856002.346427:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486306048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787856002.346479:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856002.351661:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787856002.351758:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486306048 00000100:00100000:2.0:1787856002.351770:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486306048 00000100:00100000:2.0:1787856002.351993:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787856002.352016:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+17:15762:x1874702486306048:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787856002.353804:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+17:15762:x1874702486306048:12345-0@lo:503:mount.lustre.0 Request processed in 1756us (7289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856002.353819:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787856002.353963:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486306048:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787856002.355364:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787856002.355497:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486306176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787856002.355584:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856002.355824:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787856002.355982:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486306176 00000100:00100000:1.0:1787856002.355992:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486306176 00000100:00100000:1.0:1787856002.356547:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787856002.356559:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+17:15762:x1874702486306176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856002.356934:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+17:15762:x1874702486306176:12345-0@lo:502:mount.lustre.0 Request processed in 377us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856002.356943:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787856002.357141:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486306176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787856002.357472:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787856002.357534:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787856002.357572:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787856002.357622:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787856002.357659:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787856002.357693:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787856002.357760:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787856002.357828:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787856002.357878:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787856002.357920:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486306304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787856002.357980:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856002.358015:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787856002.361930:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486306304 00000100:00100000:1.0:1787856002.361954:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486306304 00000100:00100000:1.0:1787856002.362035:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787856002.362046:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+17:15762:x1874702486306304:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856002.362473:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+17:15762:x1874702486306304:12345-0@lo:502:mount.lustre.0 Request processed in 428us (4492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856002.362483:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787856002.362686:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486306304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787856002.362871:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787856002.362891:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787856002.365134:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787856002.365152:0:15763:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787856002.365161:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787856002.365164:0:15763:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787856002.365171:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787856002.365205:0:15763:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a73d06e0000) 00000020:00000080:3.0:1787856002.365352:0:15763:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787856002.365362:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787856002.365514:0:15763:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a72c1323800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787856002.365524:0:15763:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787856002.365535:0:15763:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x516929ca3366e874 00010000:00010000:3.0:1787856002.374653:0:15763:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787856002.376479:0:15763:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787856002.382907:0:15763:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787856002.392528:0:15763:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787856002.392547:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856002.392558:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856002.392560:0:15763:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787856002.392566:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856002.392591:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856002.392593:0:15763:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787856002.392597:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787856002.392600:0:15763:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787856002.392603:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856002.392606:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856002.393417:0:15763:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787856002.393425:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787856002.393431:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856002.393433:0:15763:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787856002.393437:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787856002.393532:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787856002.393537:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787856002.393538:0:15763:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787856002.393542:0:15763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787856002.394393:0:15762:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787856002.394430:0:15762:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787856002.394469:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166ca00/0x516929ca3366e85f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e866 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.394508:0:15762:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c166ca00/0x516929ca3366e85f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e866 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856002.394518:0:15762:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a72c1323800 from 1 10000000:01000000:1.0:1787856002.394522:0:15762:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787856002.394569:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fec00/0x516929ca3366e87b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.394579:0:15762:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fec00/0x516929ca3366e87b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.394591:0:15762:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fec00/0x516929ca3366e87b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856002.395414:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486306432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787856002.395510:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856002.395569:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c61f6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787856002.395944:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486306432 00000100:00100000:2.0:1787856002.395955:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486306432 00000100:00100000:2.0:1787856002.396387:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787856002.396402:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+17:15762:x1874702486306432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787856002.396425:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856002.396447:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73d1228e00/0x516929ca3366e882 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e87b expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856002.398371:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1228e00/0x516929ca3366e882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e87b expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856002.398391:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73d1228e00/0x516929ca3366e882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e87b expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856002.398404:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228e00, rc 0) 00000100:00100000:2.0:1787856002.398511:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+18:15762:x1874702486306432:12345-0@lo:101:mount.lustre.0 Request processed in 2112us (2999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856002.398532:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787856002.398942:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486306432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787856002.398968:0:15762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fec00/0x516929ca3366e87b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e882 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.398980:0:15762:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fec00/0x516929ca3366e87b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e882 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787856002.404560:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787856002.407247:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787856002.407626:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787856002.407681:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787856002.407763:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787856002.407772:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787856002.407905:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486306560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856002.407996:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856002.408052:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c61f6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787856002.408747:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486306560 00000100:00100000:0.0:1787856002.408758:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486306560 00000100:00100000:0.0:1787856002.408856:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787856002.408868:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+18:15762:x1874702486306560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787856002.409201:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+18:15762:x1874702486306560:12345-0@lo:501:mount.lustre.0 Request processed in 335us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856002.409209:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787856002.410024:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486306560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856002.410098:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486306688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787856002.410165:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856002.410413:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c61f6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787856002.410499:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486306688 00000100:00100000:0.0:1787856002.410505:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486306688 00000100:00100000:0.0:1787856002.410559:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787856002.410569:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+18:15762:x1874702486306688:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787856002.410827:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+18:15762:x1874702486306688:12345-0@lo:503:mount.lustre.0 Request processed in 259us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856002.410844:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787856002.411023:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8492c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486306688:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787856002.412203:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787856002.412842:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486306816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787856002.412934:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856002.412975:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0240 going to sleep for 11 seconds 00000100:00100000:0.0:1787856002.413101:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486306816 00000100:00100000:0.0:1787856002.413109:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486306816 00000100:00100000:0.0:1787856002.413219:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787856002.413242:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+18:15762:x1874702486306816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787856002.413644:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+18:15762:x1874702486306816:12345-0@lo:502:mount.lustre.0 Request processed in 403us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856002.413653:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787856002.413945:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486306816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787856002.414300:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787856002.414357:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787856002.414426:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787856002.414460:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787856002.414490:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787856002.414535:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787856002.414566:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787856002.414592:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787856002.414627:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486306944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787856002.414688:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856002.416105:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0240 going to sleep for 11 seconds 00000100:00100000:1.0:1787856002.419944:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486306944 00000100:00100000:1.0:1787856002.419966:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486306944 00000100:00100000:1.0:1787856002.420105:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787856002.420118:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+18:15762:x1874702486306944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856002.421157:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+18:15762:x1874702486306944:12345-0@lo:502:mount.lustre.0 Request processed in 1037us (6464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856002.421169:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787856002.422795:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486306944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787856002.423873:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787856002.423897:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787856002.429585:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787856002.429604:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856002.429607:0:15767:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787856002.429616:0:15767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a72c1323800 00000020:00000080:0.0:1787856002.429619:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787856002.429629:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787856002.429632:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856002.429633:0:15767:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787856002.429636:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787856002.429638:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856002.429639:0:15767:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787856002.429642:0:15767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a72c1323800 00000020:00000080:0.0:1787856002.429645:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787856002.429725:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787856002.429728:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856002.429730:0:15767:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787856002.429733:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787856002.429735:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856002.429736:0:15767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787856002.429740:0:15767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a72c1323800 00000020:00000080:0.0:1787856002.429742:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787856002.437366:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787856002.437389:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787856002.437392:0:15767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787856002.437399:0:15767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787856002.440419:0:15762:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787856002.440471:0:15762:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787856002.440502:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fec00/0x516929ca3366e87b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e882 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856002.440517:0:15762:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fec00/0x516929ca3366e87b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e882 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787856002.440585:0:15762:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787856002.440593:0:15762:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a72c1323800 10000000:01000000:3.0:1787856002.440596:0:15762:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a72c1323800 10000000:01000000:3.0:1787856002.440601:0:15762:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787856002.441363:0:15762:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a72c1323800 from 1 10000000:01000000:3.0:1787856002.441369:0:15762:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787856002.441422:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366e889 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856002.441433:0:15762:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366e889 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856002.441447:0:15762:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366e889 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856002.441476:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486307072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787856002.441565:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856002.441686:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787856002.445293:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486307072 00000100:00100000:1.0:1787856002.445315:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486307072 00000100:00100000:1.0:1787856002.445390:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787856002.445402:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+18:15762:x1874702486307072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787856002.445426:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856002.445450:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e890 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e889 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.445487:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e889 expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.445515:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73fa6fe400/0x516929ca3366e890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e889 expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.445525:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe400, rc 0) 00000100:00100000:1.0:1787856002.445644:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+19:15762:x1874702486307072:12345-0@lo:101:mount.lustre.0 Request processed in 244us (4079us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856002.445653:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787856002.445737:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486307072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787856002.445760:0:15762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366e889 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e890 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.445771:0:15762:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366e889 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e890 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787856002.446543:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787856002.446911:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787856002.447174:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787856002.447221:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787856002.447255:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787856002.447305:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787856002.447346:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787856002.447428:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787856002.447468:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787856002.447505:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787856002.447556:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787856002.447593:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787856002.447628:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787856002.447680:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787856002.447730:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787856002.447767:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787856002.447847:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787856002.447884:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787856002.447915:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787856002.447958:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787856002.447991:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787856002.448023:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787856002.448069:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787856002.455735:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787856002.455827:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787856002.455923:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787856002.455967:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787856002.456005:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787856002.456062:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787856002.456118:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787856002.456158:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787856002.456242:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787856002.457745:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787856002.457846:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787856002.457879:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787856002.457951:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787856002.457992:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787856002.458043:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787856002.458109:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787856002.459821:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787856002.459851:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787856002.461378:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486307200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787856002.461476:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856002.461540:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d845f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856002.463285:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486307200 00000100:00100000:2.0:1787856002.463302:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486307200 00000100:00100000:2.0:1787856002.463377:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787856002.463389:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+19:15762:x1874702486307200:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787856002.463794:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+19:15762:x1874702486307200:12345-0@lo:501:mount.lustre.0 Request processed in 385us (2297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856002.463803:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787856002.465427:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486307200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787856002.465505:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486307328:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787856002.465592:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856002.465645:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d07d5840 going to sleep for 11 seconds 00000100:00100000:2.0:1787856002.466719:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486307328 00000100:00100000:2.0:1787856002.466732:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486307328 00000100:00100000:2.0:1787856002.466812:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787856002.466824:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+19:15762:x1874702486307328:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787856002.467091:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+19:15762:x1874702486307328:12345-0@lo:503:mount.lustre.0 Request processed in 258us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856002.467101:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787856002.467363:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486307328:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787856002.468220:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787856002.468368:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486307456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787856002.468427:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856002.468474:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d07d5840 going to sleep for 11 seconds 00000100:00100000:1.0:1787856002.468691:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486307456 00000100:00100000:1.0:1787856002.468698:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486307456 00000100:00100000:1.0:1787856002.468752:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787856002.468761:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+19:15762:x1874702486307456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856002.469063:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+19:15762:x1874702486307456:12345-0@lo:502:mount.lustre.0 Request processed in 302us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856002.469071:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787856002.469924:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486307456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787856002.470542:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787856002.470614:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787856002.470650:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787856002.470714:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787856002.470752:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787856002.470822:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787856002.470860:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787856002.470892:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787856002.470939:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787856002.470974:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787856002.471006:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787856002.471060:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787856002.471111:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787856002.471147:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787856002.471198:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787856002.474572:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787856002.474736:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787856002.474853:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787856002.474894:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787856002.474931:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787856002.474984:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787856002.475191:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787856002.475383:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787856002.475444:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787856002.475482:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787856002.475520:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787856002.475571:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787856002.475988:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787856002.476158:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787856002.476394:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787856002.476437:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787856002.476472:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787856002.476505:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787856002.476577:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787856002.476690:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787856002.476772:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787856002.476844:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787856002.476876:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787856002.476927:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787856002.476962:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787856002.477027:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df849680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486307584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787856002.477145:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856002.477212:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787856002.477896:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486307584 00000100:00100000:2.0:1787856002.477907:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486307584 00000100:00100000:2.0:1787856002.477970:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787856002.477982:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+19:15762:x1874702486307584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787856002.478557:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+19:15762:x1874702486307584:12345-0@lo:502:mount.lustre.0 Request processed in 575us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856002.478567:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787856002.478694:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df849680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486307584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787856002.478842:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787856002.478858:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787856002.481832:0:15772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787856002.481860:0:15772:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a73c51599d0) 00000020:00000080:2.0:1787856002.481888:0:15772:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787856002.482889:0:15772:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a72c1323800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787856002.482897:0:15772:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a72c1323800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787856002.482900:0:15772:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a72c1323800 3 00010000:00080000:3.0:1787856002.482957:0:15772:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a72c1a66800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.138@tcp at head 00010000:00010000:3.0:1787856002.488738:0:15772:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1787856002.489212:0:15772:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787856002.491394:0:15772:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787856002.491420:0:15772:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x516929ca3366e89e 00000100:00080000:3.0:1787856002.491434:0:15772:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787856002.491442:0:15772:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a72c1a66800 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:3.0:1787856002.491488:0:15772:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73f7648780 x1874702486307712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787856002.491526:0:15772:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787856002.491805:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787856002.491812:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787856002.491815:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a73fa532000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856002.491821:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 488 00000100:00080000:1.0:1787856002.491825:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787856002.491829:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a73fa532000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1787856002.491846:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73df84a940 x1874702486307968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787856002.491905:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486308096:0@lo:400:kworker.0 00000100:00100000:1.0:1787856002.491999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856002.492053:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856002.492060:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df849680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486307840:0@lo:400:kworker.0 00000100:00100000:1.0:1787856002.492103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856002.492147:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486308096 00000100:00100000:1.0:1787856002.492156:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486308096 00000100:00100000:1.0:1787856002.492213:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787856002.492224:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486308096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856002.492344:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486308096:12345-0@lo:400:kworker.0 Request processed in 121us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856002.492354:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787856002.492413:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73df84bc00 x1874702486308096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856002.492429:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486308096:0@lo:400:kworker.0 00000100:00100000:2.0:1787856002.492520:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7648780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874702486307712:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787856002.492570:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856002.492607:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486307968:0@lo:8:kworker.0 00000100:00100000:2.0:1787856002.492631:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856002.492803:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486308224:0@lo:400:kworker.0 00000100:00100000:2.0:1787856002.492833:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856002.492870:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486307840 00000100:00100000:2.0:1787856002.492875:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486307840 00000100:00100000:2.0:1787856002.492918:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486307968 00000100:00100000:2.0:1787856002.492922:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486307968 00000100:00100000:2.0:1787856002.492935:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787856002.492943:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df8492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874702486307840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856002.492981:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df8492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874702486307840:12345-0@lo:400:kworker.0 Request processed in 40us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856002.492987:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787856002.493001:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787856002.493006:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb676d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1874702486307968:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787856002.493056:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb676d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1874702486307968:12345-0@lo:8:kworker.0 Request processed in 48us (423us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787856002.493062:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787856002.493093:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787856002.493120:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787856002.493128:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73fa532000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787856002.493132:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787856002.493136:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486307968:0@lo:8:kworker.0 00000100:00100000:2.0:1787856002.493153:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486307712 00000100:00100000:2.0:1787856002.493156:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486307712 00000100:00100000:2.0:1787856002.493182:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486308224 00000100:00100000:2.0:1787856002.493186:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486308224 00000100:00100000:2.0:1787856002.493209:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787856002.493216:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb675a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486308224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856002.493313:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb675a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486308224:12345-0@lo:400:kworker.0 Request processed in 97us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856002.493319:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787856002.493332:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787856002.493336:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874702486307712:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787856002.493355:0:14362:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:2.0:1787856002.493396:0:14362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x516929ca3366e8a5 00000004:00100000:2.0:1787856002.493416:0:14362:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787856002.493452:0:14362:0:(import.c:65:import_set_state_nolock()) ffff9a72c1322000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787856002.493503:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874702486307712:12345-0@lo:38:llog_process_th.0 Request processed in 165us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856002.493509:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787856002.493526:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787856002.493544:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73df8483c0 x1874702486308224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787856002.493554:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486308224:0@lo:400:kworker.0 00000100:00100000:1.0:1787856002.493655:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df849680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486307840:0@lo:400:kworker.0 00010000:00080000:3.0:1787856002.493708:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a73f7648780 x1874702486307712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787856012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856002.493716:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787856002.493722:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787856002.493731:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787856002.493736:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787856002.493738:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a72c1a66800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787856002.493742:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7648780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874702486307712:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787856002.495628:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787856002.497686:0:15762:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787856002.497728:0:15762:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787856002.497762:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366e889 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e890 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.500377:0:15762:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73c166c000/0x516929ca3366e889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e890 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787856002.500463:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787856002.500466:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787856002.500468:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787856002.500469:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787856002.500471:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787856002.500472:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787856002.500474:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787856002.500477:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787856002.500479:0:15762:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787856002.500484:0:15762:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787856002.500487:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787856002.500488:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787856002.500490:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787856002.500491:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787856002.500492:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787856002.500494:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787856002.500495:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787856002.500496:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787856002.500497:0:15762:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787856002.500534:0:15762:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787856002.500561:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df849680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486308352:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787856002.500674:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856002.500827:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80d6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856002.509467:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486308352 00000100:00100000:0.0:1787856002.509485:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486308352 00000100:00100000:1.0:1787856002.509990:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787856002.510005:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c817bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+19:15762:x1874702486308352:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787856002.510054:0:14353:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787856002.510073:0:14353:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787856002.581275:0:14353:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787856002.581308:0:14353:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787856002.583333:0:14376:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787856002.583346:0:14376:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787856002.583385:0:14376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a73d1229200/0x516929ca3366e8ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856002.583410:0:14376:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73f7886e00/0x516929ca3366e786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e77f expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856002.583438:0:14376:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a73d1229200/0x516929ca3366e8ac lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856002.583494:0:14376:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73f7886e00/0x516929ca3366e786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366e77f expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856002.583513:0:14376:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a73f7886e00/0x516929ca3366e786 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366e77f expref: 19 pid: 14353 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856002.583531:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb6770c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14376:1874702486308480:0@lo:104: 00000100:00100000:2.0:1787856002.583619:0:14376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856002.583690:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856002.583867:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486308480 00000100:00100000:0.0:1787856002.583877:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486308480 00000100:00100000:0.0:1787856002.583950:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787856002.583962:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb675e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff37be87-90a7-463b-b734-d2f25b77f044+3:14376:x1874702486308480:12345-0@lo:104: 00010000:00010000:0.0:1787856002.583979:0:14344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e77f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366e786 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856002.584059:0:14344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787856002.584066:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb675e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff37be87-90a7-463b-b734-d2f25b77f044+3:14376:x1874702486308480:12345-0@lo:104: Request processed in 108us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856002.584074:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787856002.584110:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb6770c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14376:1874702486308480:0@lo:104: 00010000:00010000:3.0:1787856002.584136:0:14376:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a73d1229200/0x516929ca3366e8ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.584489:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787856002.584498:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e77f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366e786 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.584507:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe000 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:1.0:1787856002.584512:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e77f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366e786 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.584521:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e77f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366e786 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787856002.584529:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e77f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366e786 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787856002.584536:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787856002.584580:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e77f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e786 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.584588:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787856002.584624:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e77f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e786 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.584633:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fe000/0x516929ca3366e77f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e786 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.584671:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856002.584673:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856002.584675:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856002.584685:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856002.584699:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff37be87-90a7-463b-b734-d2f25b77f044:3306:1874702486308608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787856002.584741:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856002.584838:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486308608 00000100:00100000:1.0:1787856002.584843:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486308608 00010000:00010000:1.0:1787856002.584870:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73f7886e00/0x516929ca3366e786 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366e77f expref: 20 pid: 14353 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856002.584894:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787856002.584902:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff37be87-90a7-463b-b734-d2f25b77f044+20:3306:x1874702486308608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787856002.584916:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856002.584922:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73f7886e00/0x516929ca3366e786 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366e77f expref: 20 pid: 14353 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.584933:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73f7886e00/0x516929ca3366e786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366e77f expref: 20 pid: 14353 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.584948:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73f7886e00/0x516929ca3366e786 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366e77f expref: 20 pid: 14353 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.584965:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a73d1229200/0x516929ca3366e8ac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.584973:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1229200/0x516929ca3366e8ac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787856002.584999:0:14346:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013909198s 00010000:00010000:1.0:1787856002.585005:0:14346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73d1229200/0x516929ca3366e8ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.585012:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73d1229200/0x516929ca3366e8ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.585020:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a73d1229200/0x516929ca3366e8ac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.585026:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a73d1229200/0x516929ca3366e8ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.585032:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229200 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787856002.585036:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a73d1229200/0x516929ca3366e8ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.585044:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a73d1229200/0x516929ca3366e8ac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.585060:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a73d1229200/0x516929ca3366e8ac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856002.585070:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856002.585114:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ff37be87-90a7-463b-b734-d2f25b77f044+19:3306:x1874702486308608:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856002.585121:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787856002.585173:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff37be87-90a7-463b-b734-d2f25b77f044:3306:1874702486308608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787856002.585820:0:14376:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a73d1229200/0x516929ca3366e8ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856002.585832:0:14376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a73d1229200/0x516929ca3366e8ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856002.585839:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73d1229200/0x516929ca3366e8ac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856002.599697:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c817bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+18:15762:x1874702486308352:12345-0@lo:253:mount.lustre.0 Request processed in 89684us (99012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856002.599716:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787856002.599866:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df849680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ff37be87-90a7-463b-b734-d2f25b77f044:15762:1874702486308352:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787856002.599903:0:15762:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787856002.599907:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787856002.599909:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787856002.599911:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787856002.599912:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787856002.599913:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787856002.599915:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787856002.599917:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787856002.599918:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787856002.599920:0:15762:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787856002.599936:0:15762:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787856002.606245:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787856002.606449:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787856002.606649:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787856002.606850:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787856002.607005:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787856002.607241:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787856002.608614:0:15762:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1787856002.691404:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787856002.691434:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486308736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787856002.691522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856002.693786:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486308736 00000100:00100000:0.0:1787856002.693806:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486308736 00000100:00100000:0.0:1787856002.693878:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787856002.693892:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874702486308736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787856002.693939:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787856002.694049:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874702486308736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (2527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856002.694056:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787856002.694139:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486308736:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1787856002.743127:0:15762:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787856002.743142:0:15762:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787856002.743467:0:15762:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787856002.743558:0:15762:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.138@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787856002.743577:0:15762:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787856002.743618:0:15762:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00080000:0.0:1787856002.848106:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1787856002.951246:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856003.965310:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787856004.476350:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1787856004.605279:0:14357:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787856004.605286:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a73f9d8a000 from 8 10000000:01000000:2.0:1787856004.605289:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787856004.605333:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366e8b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856004.605344:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366e8b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856004.605355:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366e8b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856004.605379:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb677840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486308864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787856004.605447:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856004.605492:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50ccc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787856004.605514:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486308864 00000100:00100000:2.0:1787856004.605528:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486308864 00000100:00100000:2.0:1787856004.605571:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787856004.605580:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c817a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+18:14357:x1874702486308864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856004.605593:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856004.605605:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73d1228400/0x516929ca3366e8ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366e8b3 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856004.605628:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1228400/0x516929ca3366e8ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366e8b3 expref: 19 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856004.605639:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73d1228400/0x516929ca3366e8ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e8b3 expref: 19 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856004.605647:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228400, rc 0) 00000100:00100000:2.0:1787856004.605683:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c817a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+19:14357:x1874702486308864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856004.605690:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787856004.605736:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb677840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486308864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856004.605750:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366e8b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e8ba expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856004.605759:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366e8b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366e8ba expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856004.605825:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73cb677840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486308992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787856004.605854:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856004.605873:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c50ccc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787856004.606016:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486308992 00000100:00100000:3.0:1787856004.606021:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486308992 00000100:00100000:3.0:1787856004.606063:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787856004.606070:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c817a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+19:14357:x1874702486308992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787856004.606086:0:14353:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787856004.606100:0:14353:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787856004.606103:0:14353:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1787856004.606189:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c817a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+19:14357:x1874702486308992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856004.606196:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787856004.606698:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73cb677840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486308992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787856004.606762:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787856004.606769:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366e8b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e8ba expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856004.606805:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73d1228c00/0x516929ca3366e8b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366e8ba expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856004.992751:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856006.029345:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.040262:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787856007.805063:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787856007.805072:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787856007.805077:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a73fa532000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787856007.805103:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a73fa532000 using connection 192.168.201.138@tcp/0@lo 00000100:00100000:1.0:1787856007.805138:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a73df84b0c0 x1874702486309376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787856007.805258:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df849680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff37be87-90a7-463b-b734-d2f25b77f044:3305:1874702486309120:0@lo:400:kworker.0 00000100:00100000:1.0:1787856007.805375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856007.805448:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df8483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486309760:0@lo:400:kworker.0 00000100:00100000:1.0:1787856007.805487:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856007.805515:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856007.805520:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486309632:0@lo:400:kworker.0 00000100:00100000:1.0:1787856007.805544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856007.805572:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486309248:0@lo:400:kworker.0 00000100:00100000:1.0:1787856007.805603:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856007.805625:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787856007.805630:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486309504:0@lo:400:kworker.0 00000100:00100000:1.0:1787856007.805654:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856007.805690:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486309120 00000100:00100000:1.0:1787856007.805700:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486309120 00000100:00100000:1.0:1787856007.805753:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787856007.805763:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8179450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+19:3305:x1874702486309120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856007.805850:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8179450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+19:3305:x1874702486309120:12345-0@lo:400:kworker.0 Request processed in 88us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856007.805858:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787856007.805896:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486309760 00000100:00100000:1.0:1787856007.805901:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486309760 00000100:00100000:1.0:1787856007.805940:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486309632 00000100:00100000:1.0:1787856007.805944:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486309632 00000100:00100000:3.0:1787856007.806394:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787856007.806407:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486309888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787856007.806447:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856007.806480:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73df84b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486309376:0@lo:8:kworker.0 00000100:00100000:3.0:1787856007.806507:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856007.806552:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486309504 00000100:00100000:3.0:1787856007.806556:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486309504 00000100:00100000:1.0:1787856007.806619:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787856007.814075:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787856007.814098:0:14361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787856007.814147:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486309888 00000100:00100000:3.0:1787856007.814160:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486309888 00000100:00100000:3.0:1787856007.814214:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787856007.814229:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f76483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486309888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787856007.814281:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787856007.814399:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f76483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486309888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (7950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856007.814407:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787856007.814442:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486309248 00000100:00100000:3.0:1787856007.814447:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486309248 00000100:00100000:3.0:1787856007.817607:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486309376 00000100:00100000:3.0:1787856007.817628:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486309376 00000100:00100000:3.0:1787856007.817680:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787856007.817700:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7423c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486309248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856007.818953:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7423c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486309248:12345-0@lo:400:kworker.0 Request processed in 1253us (13339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856007.818968:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787856007.819014:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787856007.819020:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7649e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1874702486309376:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787856007.819065:0:15045:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:3.0:1787856007.819108:0:15045:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x516929ca3366e8c1 00002000:00100000:3.0:1787856007.819129:0:15045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a72c1a66000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787856007.819134:0:15045:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787856007.819138:0:15045:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787856007.819808:0:15045:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1787856007.819819:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00080000:3.0:1787856007.819848:0:15045:0:(import.c:65:import_set_state_nolock()) ffff9a72c1a60000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787856007.819850:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486309248:0@lo:400:kworker.0 00000100:00100000:3.0:1787856007.819939:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7649e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874702486309376:12345-0@lo:8:kworker.0 Request processed in 918us (13431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856007.819948:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787856007.820014:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486309888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787856007.820053:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787856007.820069:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7421a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486309632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856007.820114:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7421a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486309632:12345-0@lo:400:kworker.0 Request processed in 53us (14569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856007.820121:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787856007.820139:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787856007.820150:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787856007.820157:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7420f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486309504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856007.820195:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7420f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486309504:12345-0@lo:400:kworker.0 Request processed in 38us (14540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856007.820201:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787856007.820231:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73df84a580 x1874702486309504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856007.820244:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486309504:0@lo:400:kworker.0 00000100:00100000:1.0:1787856007.820338:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486309760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856007.820677:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486309760:12345-0@lo:400:kworker.0 Request processed in 14050us (15188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856007.820695:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787856007.820728:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787856007.820733:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787856007.821349:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73df84b0c0 x1874702486309376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787856032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787856007.821370:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787856007.821381:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787856007.821389:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787856007.821393:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9a73fa532000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787856007.821417:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787856007.821424:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874702486309376:0@lo:8:kworker.0 00000004:00080000:2.0:1787856007.821468:0:14384:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787856007.822036:0:14385:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1787856007.822063:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14385:1874702486310144:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787856007.822134:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856007.822166:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d8455e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856007.822183:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486310016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856007.822209:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856007.822247:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486310144 00000100:00100000:3.0:1787856007.822255:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486310144 00000004:00080000:2.0:1787856007.822509:0:14384:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 498674731585ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787856007.823768:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787856007.823798:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7649a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14385:x1874702486310144:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787856007.830289:0:15045:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787856007.830306:0:15045:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787856007.830314:0:15045:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00080000:1.0:1787856007.830563:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787856007.830653:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73df84a1c0 x1874702486309632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856007.830676:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df84a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486309632:0@lo:400:kworker.0 00000100:00100000:1.0:1787856007.830691:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df849680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ff37be87-90a7-463b-b734-d2f25b77f044:3305:1874702486309120:0@lo:400:kworker.0 00010000:00080000:1.0:1787856007.832262:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73df8483c0 x1874702486309760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787856023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787856007.832280:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73df8483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486309760:0@lo:400:kworker.0 00000100:00100000:3.0:1787856007.835372:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486310016 00000100:00100000:3.0:1787856007.835387:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486310016 00000100:00100000:3.0:1787856007.835446:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787856007.835458:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874702486310016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787856007.835712:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787856007.835864:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874702486310016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 409us (13654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856007.835871:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787856007.836179:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a73f7648b40 x1874702486310016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787856023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787856007.836200:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486310016:0@lo:13:osp-pre-1-0.0 00002000:00010000:3.0:1787856007.836738:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.836752:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000803cf523/0x516929ca3366e8c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.836770:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.836813:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.836823:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000803cf523/0x516929ca3366e8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.836846:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000803cf523/0x516929ca3366e8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.836858:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000803cf523/0x516929ca3366e8c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.836864:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000803cf523/0x516929ca3366e8c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.836883:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787856007.837341:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.837347:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095dbc47e/0x516929ca3366e8cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.837354:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.837357:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.837360:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095dbc47e/0x516929ca3366e8cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.837368:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095dbc47e/0x516929ca3366e8cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.837379:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095dbc47e/0x516929ca3366e8cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.837383:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095dbc47e/0x516929ca3366e8cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.837395:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787856007.837408:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787856007.837414:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000803cf523/0x516929ca3366e8c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.837419:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166c800 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787856007.837422:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000803cf523/0x516929ca3366e8c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.837430:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000803cf523/0x516929ca3366e8c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.837446:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000803cf523/0x516929ca3366e8c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.837451:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000803cf523/0x516929ca3366e8c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.837629:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856007.837639:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095dbc47e/0x516929ca3366e8cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.837647:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166dc00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787856007.837650:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095dbc47e/0x516929ca3366e8cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.837658:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095dbc47e/0x516929ca3366e8cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.837669:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095dbc47e/0x516929ca3366e8cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.837676:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095dbc47e/0x516929ca3366e8cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.837692:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.837694:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.837696:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856007.838201:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.838206:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8c00522/0x516929ca3366e8d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.838214:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.838216:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.838219:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8c00522/0x516929ca3366e8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.838235:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8c00522/0x516929ca3366e8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.838242:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8c00522/0x516929ca3366e8d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.838247:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8c00522/0x516929ca3366e8d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.838258:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856007.838263:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856007.838265:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.838274:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8c00522/0x516929ca3366e8d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.838285:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166c600 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856007.838290:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8c00522/0x516929ca3366e8d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.838301:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8c00522/0x516929ca3366e8d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.838318:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8c00522/0x516929ca3366e8d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.838327:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8c00522/0x516929ca3366e8d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.838347:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.838349:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.838359:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856007.838696:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.838700:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3a78ed7/0x516929ca3366e8dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.838706:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.838708:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.838711:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3a78ed7/0x516929ca3366e8dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.838718:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3a78ed7/0x516929ca3366e8dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.838723:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3a78ed7/0x516929ca3366e8dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.838737:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3a78ed7/0x516929ca3366e8dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.838746:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856007.838753:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856007.838755:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3a78ed7/0x516929ca3366e8dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.838760:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166d400 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787856007.838762:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3a78ed7/0x516929ca3366e8dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.838767:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3a78ed7/0x516929ca3366e8dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.838797:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3a78ed7/0x516929ca3366e8dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.838805:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3a78ed7/0x516929ca3366e8dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.838819:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.838822:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.838823:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856007.839158:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.839167:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8acf2da/0x516929ca3366e8e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.839174:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.839177:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.839180:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8acf2da/0x516929ca3366e8e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.839186:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8acf2da/0x516929ca3366e8e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.839191:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8acf2da/0x516929ca3366e8e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.839195:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8acf2da/0x516929ca3366e8e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.839204:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787856007.839614:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.839619:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dd4529a/0x516929ca3366e8eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.839625:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.839627:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.839631:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dd4529a/0x516929ca3366e8eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.839637:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dd4529a/0x516929ca3366e8eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.839648:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000dd4529a/0x516929ca3366e8eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.839653:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000dd4529a/0x516929ca3366e8eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.839662:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787856007.840167:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787856007.840172:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8acf2da/0x516929ca3366e8e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.840178:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c0030000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787856007.840180:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8acf2da/0x516929ca3366e8e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.840188:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8acf2da/0x516929ca3366e8e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.840198:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8acf2da/0x516929ca3366e8e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.840203:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8acf2da/0x516929ca3366e8e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.840217:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856007.840224:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000dd4529a/0x516929ca3366e8eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.840228:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c0031400 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787856007.840230:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000dd4529a/0x516929ca3366e8eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.840235:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000dd4529a/0x516929ca3366e8eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.840241:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000dd4529a/0x516929ca3366e8eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.840245:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dd4529a/0x516929ca3366e8eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.840257:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.840259:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.840261:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.840429:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856007.840768:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.840796:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fb542ae/0x516929ca3366e8f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.840809:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.840813:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.840819:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fb542ae/0x516929ca3366e8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.840844:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fb542ae/0x516929ca3366e8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.840852:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fb542ae/0x516929ca3366e8f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.840858:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fb542ae/0x516929ca3366e8f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.840875:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856007.841061:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856007.841069:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fb542ae/0x516929ca3366e8f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.841081:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c0031000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856007.841149:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fb542ae/0x516929ca3366e8f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.841163:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fb542ae/0x516929ca3366e8f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.841243:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fb542ae/0x516929ca3366e8f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.841253:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fb542ae/0x516929ca3366e8f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.841280:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.841283:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.841287:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856007.841312:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.841319:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5a96988/0x516929ca3366e8f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.841329:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.841331:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.841334:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5a96988/0x516929ca3366e8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.841341:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5a96988/0x516929ca3366e8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.841347:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5a96988/0x516929ca3366e8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.841361:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5a96988/0x516929ca3366e8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.841372:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856007.841380:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856007.841384:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5a96988/0x516929ca3366e8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.841389:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c0031800 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787856007.841391:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5a96988/0x516929ca3366e8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.841397:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5a96988/0x516929ca3366e8f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.841404:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5a96988/0x516929ca3366e8f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.841409:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5a96988/0x516929ca3366e8f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.841420:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.841421:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.841423:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856007.842064:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.842075:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009212d3c/0x516929ca3366e900 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842083:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.842086:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.842089:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009212d3c/0x516929ca3366e900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842095:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009212d3c/0x516929ca3366e900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842101:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009212d3c/0x516929ca3366e900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842106:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009212d3c/0x516929ca3366e900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842123:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856007.842133:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856007.842141:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009212d3c/0x516929ca3366e900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.842150:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c0031600 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856007.842154:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009212d3c/0x516929ca3366e900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.842172:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009212d3c/0x516929ca3366e900 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.842197:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009212d3c/0x516929ca3366e900 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.842207:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009212d3c/0x516929ca3366e900 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.842230:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.842233:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.842236:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856007.842463:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.842468:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0cd3cf5/0x516929ca3366e907 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842476:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.842479:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.842484:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0cd3cf5/0x516929ca3366e907 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842493:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0cd3cf5/0x516929ca3366e907 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842509:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0cd3cf5/0x516929ca3366e907 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842517:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0cd3cf5/0x516929ca3366e907 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842533:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856007.842543:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856007.842547:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0cd3cf5/0x516929ca3366e907 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842555:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c0031200 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787856007.842559:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0cd3cf5/0x516929ca3366e907 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842569:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0cd3cf5/0x516929ca3366e907 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842580:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0cd3cf5/0x516929ca3366e907 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842586:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0cd3cf5/0x516929ca3366e907 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842597:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.842603:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.842604:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856007.842958:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.842963:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000343b8b93/0x516929ca3366e90e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842969:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.842971:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.842974:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000343b8b93/0x516929ca3366e90e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842980:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000343b8b93/0x516929ca3366e90e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.842986:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000343b8b93/0x516929ca3366e90e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.843006:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000343b8b93/0x516929ca3366e90e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.843026:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856007.843088:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856007.843094:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000343b8b93/0x516929ca3366e90e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.843104:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402172000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856007.843109:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000343b8b93/0x516929ca3366e90e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.843119:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000343b8b93/0x516929ca3366e90e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.843133:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000343b8b93/0x516929ca3366e90e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.843155:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000343b8b93/0x516929ca3366e90e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.843232:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.843235:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.843236:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856007.843405:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.843409:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e0a87b7/0x516929ca3366e915 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.843416:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.843419:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.843421:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e0a87b7/0x516929ca3366e915 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.843434:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e0a87b7/0x516929ca3366e915 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.843440:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e0a87b7/0x516929ca3366e915 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.843445:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e0a87b7/0x516929ca3366e915 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.843454:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856007.843461:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856007.843463:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e0a87b7/0x516929ca3366e915 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.843468:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402173e00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787856007.843471:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e0a87b7/0x516929ca3366e915 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.843479:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e0a87b7/0x516929ca3366e915 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.843491:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e0a87b7/0x516929ca3366e915 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.843499:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e0a87b7/0x516929ca3366e915 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.843523:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.843525:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.843527:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856007.844046:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.844053:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7569345/0x516929ca3366e91c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.844062:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.844066:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.844070:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7569345/0x516929ca3366e91c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.844077:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7569345/0x516929ca3366e91c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.844084:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7569345/0x516929ca3366e91c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.844088:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7569345/0x516929ca3366e91c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.844105:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856007.844152:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856007.844160:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7569345/0x516929ca3366e91c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.844169:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402172400 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856007.844175:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7569345/0x516929ca3366e91c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.844251:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7569345/0x516929ca3366e91c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.844266:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7569345/0x516929ca3366e91c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.844274:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7569345/0x516929ca3366e91c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.844290:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.844292:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.844294:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856007.844457:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.844461:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009194c087/0x516929ca3366e923 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.844478:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.844482:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.844486:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009194c087/0x516929ca3366e923 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.844496:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009194c087/0x516929ca3366e923 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.844505:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009194c087/0x516929ca3366e923 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.844513:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009194c087/0x516929ca3366e923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.844529:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856007.844539:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856007.844544:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009194c087/0x516929ca3366e923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.844551:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402173800 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787856007.844555:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009194c087/0x516929ca3366e923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.844562:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009194c087/0x516929ca3366e923 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.844586:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009194c087/0x516929ca3366e923 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.844595:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009194c087/0x516929ca3366e923 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.844609:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.844611:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.844613:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856007.845036:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.845043:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009463c6a4/0x516929ca3366e92a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845052:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.845055:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.845058:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009463c6a4/0x516929ca3366e92a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845066:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009463c6a4/0x516929ca3366e92a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845072:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009463c6a4/0x516929ca3366e92a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845077:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009463c6a4/0x516929ca3366e92a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845100:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787856007.845628:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.845634:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566cd881/0x516929ca3366e931 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845641:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.845644:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.845647:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566cd881/0x516929ca3366e931 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845653:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566cd881/0x516929ca3366e931 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845658:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566cd881/0x516929ca3366e931 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845664:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000566cd881/0x516929ca3366e931 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845673:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787856007.845680:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787856007.845684:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009463c6a4/0x516929ca3366e92a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845688:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402172c00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787856007.845696:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009463c6a4/0x516929ca3366e92a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845703:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009463c6a4/0x516929ca3366e92a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845711:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009463c6a4/0x516929ca3366e92a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845716:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009463c6a4/0x516929ca3366e92a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845726:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856007.845728:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000566cd881/0x516929ca3366e931 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845732:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402173200 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787856007.845734:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000566cd881/0x516929ca3366e931 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845739:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000566cd881/0x516929ca3366e931 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845744:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000566cd881/0x516929ca3366e931 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845748:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566cd881/0x516929ca3366e931 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.845761:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.845763:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.845765:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.846049:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856007.846226:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.846231:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047a32189/0x516929ca3366e938 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.846237:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.846240:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.846243:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047a32189/0x516929ca3366e938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.846250:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047a32189/0x516929ca3366e938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.846255:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047a32189/0x516929ca3366e938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.846260:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047a32189/0x516929ca3366e938 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.846272:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856007.846279:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787856007.846283:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047a32189/0x516929ca3366e938 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.846301:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402172e00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787856007.846305:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047a32189/0x516929ca3366e938 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.846315:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047a32189/0x516929ca3366e938 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.846327:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047a32189/0x516929ca3366e938 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.846333:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047a32189/0x516929ca3366e938 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.846343:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.846344:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.846345:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787856007.846772:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.846798:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b6520f6/0x516929ca3366e93f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.846806:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.846809:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.846813:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b6520f6/0x516929ca3366e93f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.846822:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b6520f6/0x516929ca3366e93f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.846838:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b6520f6/0x516929ca3366e93f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.846846:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b6520f6/0x516929ca3366e93f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.846859:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856007.846939:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856007.846948:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b6520f6/0x516929ca3366e93f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787856007.847234:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.847240:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087be75bc/0x516929ca3366e946 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.847246:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.847249:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.847252:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087be75bc/0x516929ca3366e946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.847258:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087be75bc/0x516929ca3366e946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.847264:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087be75bc/0x516929ca3366e946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.847272:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087be75bc/0x516929ca3366e946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.847298:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787856007.847308:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1787856007.847759:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787856007.847760:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402173a00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787856007.847767:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ad9418e/0x516929ca3366e94d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.847768:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b6520f6/0x516929ca3366e93f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.847809:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787856007.847812:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b6520f6/0x516929ca3366e93f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.847814:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.847824:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ad9418e/0x516929ca3366e94d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.847836:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b6520f6/0x516929ca3366e93f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.847838:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ad9418e/0x516929ca3366e94d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.847858:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b6520f6/0x516929ca3366e93f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.847859:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ad9418e/0x516929ca3366e94d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.847881:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ad9418e/0x516929ca3366e94d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.847888:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856007.847897:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856007.847902:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ad9418e/0x516929ca3366e94d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.847910:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402172200 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856007.847914:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ad9418e/0x516929ca3366e94d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.847922:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ad9418e/0x516929ca3366e94d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.847943:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ad9418e/0x516929ca3366e94d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787856007.848416:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.848421:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a36063f9/0x516929ca3366e954 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.848427:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.848433:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.848437:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a36063f9/0x516929ca3366e954 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.848444:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a36063f9/0x516929ca3366e954 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.848449:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a36063f9/0x516929ca3366e954 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.848454:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a36063f9/0x516929ca3366e954 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.848460:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787856007.848663:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ad9418e/0x516929ca3366e94d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787856007.848932:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.848936:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f213f4d/0x516929ca3366e95b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.848941:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.848943:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.848946:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f213f4d/0x516929ca3366e95b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.848952:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f213f4d/0x516929ca3366e95b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.848957:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f213f4d/0x516929ca3366e95b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.848966:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f213f4d/0x516929ca3366e95b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.848971:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787856007.849327:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.849333:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee63480a/0x516929ca3366e962 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.849342:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.849344:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.849347:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee63480a/0x516929ca3366e962 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.849353:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee63480a/0x516929ca3366e962 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.849358:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee63480a/0x516929ca3366e962 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.849362:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee63480a/0x516929ca3366e962 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.849369:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787856007.849837:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.849843:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f90dbc8/0x516929ca3366e969 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.849858:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.849861:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.849864:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f90dbc8/0x516929ca3366e969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.849872:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f90dbc8/0x516929ca3366e969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.849878:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f90dbc8/0x516929ca3366e969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.849885:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f90dbc8/0x516929ca3366e969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.849892:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1787856007.849910:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787856007.849918:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a36063f9/0x516929ca3366e954 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.849937:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337e200 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856007.849943:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a36063f9/0x516929ca3366e954 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.849961:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a36063f9/0x516929ca3366e954 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.849981:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a36063f9/0x516929ca3366e954 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.850005:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a36063f9/0x516929ca3366e954 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.850026:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787856007.850037:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f213f4d/0x516929ca3366e95b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.850053:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337fe00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856007.850058:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f213f4d/0x516929ca3366e95b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.850075:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f213f4d/0x516929ca3366e95b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.850087:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f213f4d/0x516929ca3366e95b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.850109:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f213f4d/0x516929ca3366e95b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.850126:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787856007.850136:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee63480a/0x516929ca3366e962 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.850143:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337ec00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856007.850147:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee63480a/0x516929ca3366e962 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.850155:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee63480a/0x516929ca3366e962 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.850174:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee63480a/0x516929ca3366e962 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787856007.850316:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.850323:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000307da41f/0x516929ca3366e970 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.850332:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.850336:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.850339:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000307da41f/0x516929ca3366e970 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.850348:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000307da41f/0x516929ca3366e970 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.850363:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000307da41f/0x516929ca3366e970 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.850369:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000307da41f/0x516929ca3366e970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.850378:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787856007.850971:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.850976:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000798a2603/0x516929ca3366e977 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.850984:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.850997:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.851002:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000798a2603/0x516929ca3366e977 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.851012:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000798a2603/0x516929ca3366e977 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.851021:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000798a2603/0x516929ca3366e977 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.851029:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000798a2603/0x516929ca3366e977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.851050:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787856007.851266:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee63480a/0x516929ca3366e962 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.851285:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787856007.851290:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f90dbc8/0x516929ca3366e969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.851299:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337fa00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856007.851303:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f90dbc8/0x516929ca3366e969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.851313:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f90dbc8/0x516929ca3366e969 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.851327:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f90dbc8/0x516929ca3366e969 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.851336:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f90dbc8/0x516929ca3366e969 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.851357:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787856007.851362:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000307da41f/0x516929ca3366e970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.851369:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337ee00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856007.851380:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000307da41f/0x516929ca3366e970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.851389:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000307da41f/0x516929ca3366e970 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.851402:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000307da41f/0x516929ca3366e970 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.851412:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000307da41f/0x516929ca3366e970 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.851427:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856007.851431:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000798a2603/0x516929ca3366e977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787856007.851437:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787856007.851440:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337ea00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787856007.851443:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bb0e9dd/0x516929ca3366e97e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.851447:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000798a2603/0x516929ca3366e977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.851453:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.851459:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856007.851465:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000798a2603/0x516929ca3366e977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.851478:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000798a2603/0x516929ca3366e977 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.851487:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000798a2603/0x516929ca3366e977 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.851528:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bb0e9dd/0x516929ca3366e97e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.851540:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bb0e9dd/0x516929ca3366e97e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.851549:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bb0e9dd/0x516929ca3366e97e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.851558:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bb0e9dd/0x516929ca3366e97e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.851569:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787856007.852146:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787856007.852151:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366e985 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.852158:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=498s v=(0 0) 00010000:00010000:3.0:1787856007.852164:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856007.852168:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366e985 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.852175:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366e985 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.852181:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366e985 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.852185:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366e985 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.852191:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787856007.852281:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787856007.852287:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bb0e9dd/0x516929ca3366e97e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.852296:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337e600 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856007.852301:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bb0e9dd/0x516929ca3366e97e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.852311:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bb0e9dd/0x516929ca3366e97e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.852325:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bb0e9dd/0x516929ca3366e97e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.852334:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bb0e9dd/0x516929ca3366e97e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.852354:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856007.852358:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366e985 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787856007.852363:0:15045:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00010000:00010000:0.0:1787856007.852366:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337fc00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856007.852371:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366e985 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.852393:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366e985 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.852405:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366e985 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.852413:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366e985 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856007.852435:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.852438:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.852442:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856007.852546:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7649a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14385:x1874702486310144:12345-0@lo:5:osp-pre-1-0.0 Request processed in 28748us (30405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856007.852560:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787856007.852629:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14385:1874702486310144:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787856007.852646:0:14385:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1787856007.852696:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f764b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14385:1874702486310272:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787856007.852732:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856007.852759:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c60be6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856007.852797:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486310272 00000100:00100000:1.0:1787856007.852806:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486310272 00000100:00100000:1.0:1787856007.852864:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787856007.852876:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7648b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14385:x1874702486310272:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787856007.852924:0:15044:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1787856007.860152:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7648b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14385:x1874702486310272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7266us (7406us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787856007.860170:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787856007.860176:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f764b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14385:1874702486310272:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787856007.860197:0:14385:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1787856007.862104:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.862111:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856007.862114:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.862119:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087be75bc/0x516929ca3366e946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.862133:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a7402173400 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787856007.862138:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087be75bc/0x516929ca3366e946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.862149:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087be75bc/0x516929ca3366e946 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.862173:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087be75bc/0x516929ca3366e946 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.862179:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087be75bc/0x516929ca3366e946 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856007.862195:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.862196:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787856007.862197:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787856007.871593:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787856008.059944:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856009.092466:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787856009.129484:0:16123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg138-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787856010.124855:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856011.132025:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856012.008436:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856012.008506:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464296064 00000100:00100000:0.0:1787856012.008517:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464296064 00000100:00100000:0.0:1787856012.008561:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:0.0:1787856012.008570:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8178850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2356:x1874702464296064:12345-192.168.201.38@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787856012.008598:0:14354:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from dc66c119-c344-45de-bbb7-cac8e3170df7@192.168.201.38@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:0.0:1787856012.008625:0:14354:0:(genops.c:1385:class_connect()) connect: client dc66c119-c344-45de-bbb7-cac8e3170df7, cookie 0x516929ca3366e98c 00000100:00080000:0.0:1787856012.008759:0:14354:0:(import.c:65:import_set_state_nolock()) ffff9a72c2d92000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856012.008867:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8178850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+5:2356:x1874702464296064:12345-192.168.201.38@tcp:250:mount.lustre.0 Request processed in 295us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856012.008875:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 74 00000100:00100000:0.0:1787856012.018375:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856012.018498:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464296192 00000100:00100000:3.0:1787856012.018508:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464296192 00000100:00100000:3.0:1787856012.018564:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:3.0:1787856012.018575:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c817b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+5:13750:x1874702464296192:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787856012.018593:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856012.018612:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a72c337e800/0x516929ca3366e993 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616eb2 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856012.018659:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a72c337e800/0x516929ca3366e993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616eb2 expref: 6 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856012.018670:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a72c337e800/0x516929ca3366e993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616eb2 expref: 6 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856012.018680:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a72c337e800, rc 0) 00000100:00100000:3.0:1787856012.018741:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c817b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+6:13750:x1874702464296192:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 168us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856012.018747:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 75 00000100:00100000:2.0:1787856012.023281:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856012.023368:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464296320 00000100:00100000:0.0:1787856012.023378:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464296320 00000100:00100000:0.0:1787856012.023432:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:0.0:1787856012.023442:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+6:13750:x1874702464296320:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787856012.023757:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+6:13750:x1874702464296320:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 315us (483us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787856012.023766:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 76 00000100:00100000:2.0:1787856012.030136:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856012.030273:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464296448 00000100:00100000:1.0:1787856012.030283:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464296448 00000100:00100000:1.0:1787856012.030337:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 77 00000100:00100000:1.0:1787856012.030348:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+6:13750:x1874702464296448:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787856012.030379:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856012.030397:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73fa6ff200/0x516929ca3366e99a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616eb9 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856012.030427:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73fa6ff200/0x516929ca3366e99a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616eb9 expref: 7 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856012.030438:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73fa6ff200/0x516929ca3366e99a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616eb9 expref: 7 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856012.030446:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ff200, rc 0) 00000100:00100000:1.0:1787856012.030509:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+7:13750:x1874702464296448:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 162us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856012.030516:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 77 00000100:00100000:1.0:1787856012.034689:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856012.034803:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464296576 00000100:00100000:3.0:1787856012.034813:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464296576 00000100:00100000:3.0:1787856012.034865:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:3.0:1787856012.034877:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+7:13750:x1874702464296576:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787856012.035650:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+8:13750:x1874702464296576:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 772us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856012.035659:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 78 00000100:00100000:2.0:1787856012.042181:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856012.042332:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464296704 00000100:00100000:0.0:1787856012.042344:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464296704 00000100:00100000:0.0:1787856012.042410:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:0.0:1787856012.042426:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+8:13750:x1874702464296704:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787856012.042931:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+8:13750:x1874702464296704:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 506us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856012.042941:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 79 00000100:00100000:2.0:1787856012.058131:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856012.058958:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464296832 00000100:00100000:3.0:1787856012.058969:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464296832 00000100:00100000:3.0:1787856012.059034:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:3.0:1787856012.059043:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+8:13769:x1874702464296832:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787856012.059388:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+8:13769:x1874702464296832:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 344us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856012.059396:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 80 00000100:00100000:2.0:1787856012.077229:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856012.077293:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464296960 00000100:00100000:0.0:1787856012.077304:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464296960 00000100:00100000:0.0:1787856012.077366:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:0.0:1787856012.077377:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+8:13769:x1874702464296960:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787856012.077657:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+8:13769:x1874702464296960:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 280us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856012.077665:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 81 00000100:00100000:2.0:1787856012.083645:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856012.089339:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464297088 00000100:00100000:3.0:1787856012.089365:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464297088 00000100:00100000:2.0:1787856012.100638:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:2.0:1787856012.100673:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+8:13750:x1874702464297088:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787856012.100699:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856012.100726:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73d1229a00/0x516929ca3366e9a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616ee3 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856012.100764:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1229a00/0x516929ca3366e9a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ee3 expref: 9 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856012.100998:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73d1229a00/0x516929ca3366e9a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ee3 expref: 9 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856012.101016:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229a00, rc 0) 00000100:00100000:2.0:1787856012.101389:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+9:13750:x1874702464297088:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 729us (17757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856012.103149:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 82 00000100:00100000:2.0:1787856012.106905:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856012.107141:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464297216 00000100:00100000:0.0:1787856012.107151:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464297216 00000100:00100000:0.0:1787856012.107207:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 83 00000100:00100000:0.0:1787856012.107217:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+9:13750:x1874702464297216:12345-192.168.201.38@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787856012.107243:0:14354:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787856012.107266:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787856012.107270:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787856012.107274:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787856012.107276:0:14354:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787856012.109378:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+9:13750:x1874702464297216:12345-192.168.201.38@tcp:256:mount.lustre.0 Request processed in 2151us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856012.109393:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 83 00000100:00100000:2.0:1787856012.113265:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856012.113542:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464297344 00000100:00100000:0.0:1787856012.113552:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464297344 00000100:00100000:0.0:1787856012.114254:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:0.0:1787856012.114268:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+9:13750:x1874702464297344:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787856012.114284:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856012.114303:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c5142e00/0x516929ca3366e9a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616eea expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856012.114329:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c5142e00/0x516929ca3366e9a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616eea expref: 10 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856012.114340:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c5142e00/0x516929ca3366e9a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616eea expref: 10 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856012.114348:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142e00, rc 0) 00000100:00100000:0.0:1787856012.114414:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+10:13750:x1874702464297344:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 151us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856012.114436:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 84 00000100:00100000:2.0:1787856012.119382:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856012.119470:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464297472 00000100:00100000:1.0:1787856012.119479:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464297472 00000100:00100000:1.0:1787856012.119529:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:1.0:1787856012.119539:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+10:13750:x1874702464297472:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787856012.119965:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+10:13750:x1874702464297472:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 426us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856012.119973:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 85 00000100:00100000:3.0:1787856012.122281:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856012.122371:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464297600 00000100:00100000:0.0:1787856012.122380:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464297600 00000100:00100000:0.0:1787856012.122430:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:0.0:1787856012.122438:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+10:13750:x1874702464297600:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787856012.122834:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+10:13750:x1874702464297600:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 394us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856012.122842:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 86 00000100:00100000:0.0:1787856012.127722:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856012.127816:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464297728 00000100:00100000:2.0:1787856012.127826:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464297728 00000100:00100000:2.0:1787856012.127884:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 87 00000100:00100000:2.0:1787856012.127895:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c8f57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+10:13775:x1874702464297728:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787856012.128215:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c8f57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+10:13775:x1874702464297728:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 320us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856012.128223:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 87 00000100:00100000:2.0:1787856012.134227:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856012.134329:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464297856 00000100:00100000:1.0:1787856012.134339:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464297856 00000100:00100000:1.0:1787856012.134396:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 88 00000100:00100000:1.0:1787856012.134407:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c600b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+10:13775:x1874702464297856:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787856012.134992:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c600b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+10:13775:x1874702464297856:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 582us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856012.135008:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 88 00000100:00100000:3.0:1787856012.144684:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856012.145066:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464297984 00000100:00100000:0.0:1787856012.145077:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464297984 00000100:00100000:0.0:1787856012.145125:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:0.0:1787856012.145134:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1874702464297984:12345-192.168.201.38@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787856012.145165:0:14361:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from ae33b44f-c9e3-446c-bea8-6bb64f60aa30@192.168.201.38@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:0.0:1787856012.145219:0:14361:0:(genops.c:1385:class_connect()) connect: client ae33b44f-c9e3-446c-bea8-6bb64f60aa30, cookie 0x516929ca3366e9af 00000004:00100000:0.0:1787856012.145250:0:14361:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787856012.145256:0:14361:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1787856012.156322:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787856012.190457:0:14361:0:(import.c:65:import_set_state_nolock()) ffff9a72c2d90000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856012.190597:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:2356:x1874702464297984:12345-192.168.201.38@tcp:38:mount.lustre.0 Request processed in 45461us (45921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856012.190610:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:0.0:1787856012.199497:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856012.199540:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856012.199639:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464298112 00000100:00100000:1.0:1787856012.199650:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464298112 00000100:00100000:1.0:1787856012.199718:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464298240 00000100:00100000:1.0:1787856012.199721:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464298240 00000100:00100000:1.0:1787856012.199741:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:1.0:1787856012.199750:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:0:x1874702464298112:12345-192.168.201.38@tcp:41:mount.lustre.0 00000100:00080000:3.0:1787856012.199811:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1787856012.199821:0:14360:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787856012.199926:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:0:x1874702464298112:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 175us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856012.199933:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:1.0:1787856012.199953:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:1.0:1787856012.199960:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:13750:x1874702464298240:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787856012.199970:0:14360:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787856012.199991:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:13750:x1874702464298240:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 32us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856012.199996:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:2.0:1787856012.203307:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856012.203458:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464298368 00000100:00100000:1.0:1787856012.203469:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464298368 00000100:00100000:1.0:1787856012.203529:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:1.0:1787856012.203541:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb674b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:13750:x1874702464298368:12345-192.168.201.38@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787856012.203686:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb674b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:13750:x1874702464298368:12345-192.168.201.38@tcp:40:mount.lustre.0 Request processed in 147us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856012.203694:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:3.0:1787856012.211332:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856012.211368:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856012.211400:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856012.211453:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464298752 00000100:00100000:1.0:1787856012.211462:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464298752 00000100:00100000:1.0:1787856012.211515:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1787856012.211525:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:13750:x1874702464298752:12345-192.168.201.38@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787856012.212202:0:14363:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 611us 00000100:00100000:2.0:1787856012.215003:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464298496 00000100:00100000:2.0:1787856012.215016:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464298496 00000100:00100000:2.0:1787856012.215050:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464298624 00000100:00100000:2.0:1787856012.215054:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464298624 00000100:00100000:2.0:1787856012.215072:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:2.0:1787856012.215081:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7648780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1874702464298496:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787856012.215111:0:15046:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from ae33b44f-c9e3-446c-bea8-6bb64f60aa30@192.168.201.38@tcp t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:2.0:1787856012.215144:0:15046:0:(genops.c:1385:class_connect()) connect: client ae33b44f-c9e3-446c-bea8-6bb64f60aa30, cookie 0x516929ca3366e9b6 00002000:00100000:2.0:1787856012.215156:0:15046:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ae33b44f-c9e3-446c-bea8-6bb64f60aa30/ffff9a72c1322800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787856012.215180:0:15046:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787856012.215462:0:15046:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787856012.215492:0:15046:0:(import.c:65:import_set_state_nolock()) ffff9a72c1321800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787856012.215569:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7648780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:2356:x1874702464298496:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 488us (4245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856012.215577:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:2.0:1787856012.215594:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:2.0:1787856012.215598:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1874702464298624:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787856012.215612:0:15046:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from ae33b44f-c9e3-446c-bea8-6bb64f60aa30@192.168.201.38@tcp t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:2.0:1787856012.215626:0:15046:0:(genops.c:1385:class_connect()) connect: client ae33b44f-c9e3-446c-bea8-6bb64f60aa30, cookie 0x516929ca3366e9bd 00002000:00100000:2.0:1787856012.215637:0:15046:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ae33b44f-c9e3-446c-bea8-6bb64f60aa30/ffff9a72c1324800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787856012.215651:0:15046:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787856012.215759:0:15046:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787856012.215798:0:15046:0:(import.c:65:import_set_state_nolock()) ffff9a73d0d04000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787856012.215833:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:2356:x1874702464298624:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 233us (4432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856012.215840:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000004:00200000:2.0:1787856012.230646:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787856012.231021:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:13750:x1874702464298752:12345-192.168.201.38@tcp:33:mount.lustre.0 Request processed in 19490us (19644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856012.231037:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:3.0:1787856012.489086:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856012.489245:0:16043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464298880 00000100:00100000:2.0:1787856012.489255:0:16043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464298880 00000100:00100000:2.0:1787856012.489321:0:16043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:2.0:1787856012.489331:0:16043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:13796:x1874702464298880:12345-192.168.201.38@tcp:101:mkdir.0 00010000:00010000:2.0:1787856012.489351:0:16043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856012.489378:0:16043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229800/0x516929ca3366e9c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616f14 expref: -99 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856012.489445:0:16043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366e9cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856012.489459:0:16043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366e9cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856012.489472:0:16043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366e9cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856012.489693:0:16043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787856012.489697:0:16043:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787856012.489828:0:16043:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366e9cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856012.489856:0:16043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229800/0x516929ca3366e9c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f14 expref: 8 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856012.489874:0:16043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366e9cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f14 expref: 7 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856012.489883:0:16043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:2.0:1787856012.489887:0:16043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787856012.489890:0:16043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228200, rc 0) 00000100:00100000:2.0:1787856012.489966:0:16043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:13796:x1874702464298880:12345-192.168.201.38@tcp:101:mkdir.0 Request processed in 635us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856012.489974:0:16043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:2.0:1787856012.924037:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff37be87-90a7-463b-b734-d2f25b77f044:3304:1874702486310400:0@lo:400:kworker.0 00000100:00100000:1.0:1787856012.924077:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7422d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486310528:0@lo:400:kworker.0 00000100:00100000:3.0:1787856012.924821:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7420b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486310656:0@lo:400:kworker.0 00000100:00100000:1.0:1787856012.929686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856012.929762:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486311040:0@lo:400:kworker.0 00000100:00100000:1.0:1787856012.929822:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856012.929849:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486311040 00000100:00100000:1.0:1787856012.929868:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486311040 00000100:00100000:1.0:1787856012.929939:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787856012.929948:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486311040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856012.929995:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74230c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874702486311040:12345-0@lo:400:kworker.0 Request processed in 48us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856012.930002:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787856012.930048:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874702486311040:0@lo:400:kworker.0 00000100:00100000:1.0:1787856012.930068:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787856012.930075:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7420780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486310912:0@lo:400:kworker.0 00000100:00100000:1.0:1787856012.930099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856012.930152:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486310528 00000100:00100000:1.0:1787856012.930156:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486310528 00000100:00100000:1.0:1787856012.930187:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787856012.930309:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486310528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856012.930530:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486310528:12345-0@lo:400:kworker.0 Request processed in 336us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856012.930538:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787856012.930698:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486310784:0@lo:400:kworker.0 00000100:00100000:1.0:1787856012.930729:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856012.930748:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7421e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486311296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856012.930771:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856012.930817:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787856012.930824:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7421680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486311168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787856012.930847:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856012.933097:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486310912 00000100:00100000:1.0:1787856012.933113:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486310912 00000100:00100000:1.0:1787856012.933161:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486310784 00000100:00100000:1.0:1787856012.933165:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486310784 00000100:00100000:1.0:1787856012.933189:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787856012.936743:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486310912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856012.936861:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874702486310912:12345-0@lo:400:kworker.0 Request processed in 3663us (6759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856012.936871:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787856012.936919:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787856012.936928:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7423840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486310784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856012.936973:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7423840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486310784:12345-0@lo:400:kworker.0 Request processed in 46us (6243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856012.936980:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787856012.937018:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486311296 00000100:00100000:1.0:1787856012.937026:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486311296 00000100:00100000:1.0:1787856012.937055:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486311168 00000100:00100000:1.0:1787856012.937058:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486311168 00000100:00100000:1.0:1787856012.937071:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787856012.937077:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874702486311296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787856012.937107:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787856012.937143:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874702486311296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (6370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856012.937150:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787856012.937163:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787856012.937170:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7422940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486311168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787856012.937181:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787856012.939537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787856012.939662:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787856012.939668:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787856012.939671:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856012.940686:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7420780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874702486310912:0@lo:400:kworker.0 00000100:00100000:2.0:1787856012.940701:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7422d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486310528:0@lo:400:kworker.0 00000100:00100000:2.0:1787856012.940748:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486310400 00000100:00100000:2.0:1787856012.940753:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486310400 00000100:00100000:2.0:1787856012.940824:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787856012.940831:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c600ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+19:3304:x1874702486310400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856012.940894:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c600ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+19:3304:x1874702486310400:12345-0@lo:400:kworker.0 Request processed in 63us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856012.940915:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787856012.940954:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff37be87-90a7-463b-b734-d2f25b77f044:3304:1874702486310400:0@lo:400:kworker.0 00000100:00100000:1.0:1787856012.945260:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7422940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486311168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8080us (14402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856012.945275:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787856012.945371:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7421680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486311168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787856012.945390:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486310784:0@lo:400:kworker.0 00000100:00100000:1.0:1787856012.945408:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7421e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486311296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856012.951135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856012.953757:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486310656 00000100:00100000:0.0:1787856012.953771:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486310656 00000100:00100000:0.0:1787856012.953857:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787856012.953867:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7447c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1874702486310656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856012.953973:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7447c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1874702486310656:12345-0@lo:400:kworker.0 Request processed in 106us (2845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856012.953982:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787856012.958853:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7420b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486310656:0@lo:400:kworker.0 00000001:00100000:0.0:1787856012.995979:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ae33b44f-c9e3-446c-bea8-6bb64f60aa30 00000001:00080000:1.0:1787856013.027151:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1787856013.027536:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ae33b44f-c9e3-446c-bea8-6bb64f60aa30 00000001:00100000:1.0:1787856013.027670:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787856013.180120:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856014.204329:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856014.578843:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856014.579062:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464299008 00000100:00100000:1.0:1787856014.579073:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464299008 00000100:00100000:1.0:1787856014.579153:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:1.0:1787856014.579164:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:13848:x1874702464299008:12345-192.168.201.38@tcp:41:lfs.0 00000004:00000024:1.0:1787856014.579209:0:14362:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787856014.579298:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:13848:x1874702464299008:12345-192.168.201.38@tcp:41:lfs.0 Request processed in 136us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856014.579320:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00080000:2.0:1787856014.579397:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787856014.581349:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856014.581525:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464299136 00000100:00100000:2.0:1787856014.581536:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464299136 00000100:00100000:2.0:1787856014.581613:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:2.0:1787856014.581623:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7444f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:13848:x1874702464299136:12345-192.168.201.38@tcp:13:lfs.0 00002000:00000024:2.0:1787856014.581659:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787856014.581745:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7444f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:13848:x1874702464299136:12345-192.168.201.38@tcp:13:lfs.0 Request processed in 123us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856014.581754:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00080000:3.0:1787856014.582154:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787856014.584417:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856014.584965:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464299264 00000100:00100000:2.0:1787856014.584987:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464299264 00000100:00100000:2.0:1787856014.585176:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:2.0:1787856014.585189:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:13848:x1874702464299264:12345-192.168.201.38@tcp:13:lfs.0 00002000:00000024:2.0:1787856014.585238:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787856014.585566:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:13848:x1874702464299264:12345-192.168.201.38@tcp:13:lfs.0 Request processed in 379us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856014.585575:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00080000:3.0:1787856014.585727:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1787856014.717376:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787856014.873730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856014.875184:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464299392 00000100:00100000:1.0:1787856014.875204:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464299392 00000100:00100000:1.0:1787856014.875294:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00100000:1.0:1787856014.875307:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c6008050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+10:13880:x1874702464299392:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787856014.875331:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856014.875359:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73fa6ffc00/0x516929ca3366e9d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616f1b expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856014.875397:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73fa6ffc00/0x516929ca3366e9d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f1b expref: 11 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856014.875411:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73fa6ffc00/0x516929ca3366e9d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f1b expref: 11 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856014.875423:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ffc00, rc 0) 00000100:00100000:1.0:1787856014.876206:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c6008050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+11:13880:x1874702464299392:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 895us (2484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856014.876219:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 90 00000100:00100000:0.0:1787856014.882895:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856014.883927:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464299520 00000100:00100000:2.0:1787856014.883943:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464299520 00000100:00100000:2.0:1787856014.884128:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 91 00000100:00100000:2.0:1787856014.884158:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c600a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+11:13880:x1874702464299520:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787856014.884885:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c600a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+11:13880:x1874702464299520:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 727us (2016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856014.884895:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 91 00000100:00100000:0.0:1787856014.914102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856014.914263:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464299648 00000100:00100000:1.0:1787856014.914278:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464299648 00000100:00100000:1.0:1787856014.914353:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 92 00000100:00100000:1.0:1787856014.914366:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c600b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+11:13880:x1874702464299648:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787856014.914847:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c600b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+11:13880:x1874702464299648:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 480us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856014.914886:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 92 00000100:00100000:0.0:1787856014.940376:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856014.945084:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464299776 00000100:00100000:2.0:1787856014.945108:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464299776 00000100:00100000:2.0:1787856014.945219:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 93 00000100:00100000:2.0:1787856014.945235:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c6008c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+11:13887:x1874702464299776:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787856014.945715:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c6008c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+11:13887:x1874702464299776:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 481us (5352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856014.945726:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 93 00000100:00100000:3.0:1787856014.986186:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856014.991832:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464299904 00000100:00100000:0.0:1787856014.991858:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464299904 00000100:00100000:1.0:1787856015.002005:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00100000:1.0:1787856015.002034:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c600bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+11:13887:x1874702464299904:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787856015.002457:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c600bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+11:13887:x1874702464299904:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 427us (16288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856015.002467:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 94 00000100:00100000:0.0:1787856015.009045:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856015.009845:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464300032 00000100:00100000:1.0:1787856015.009861:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464300032 00000100:00100000:1.0:1787856015.009972:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 95 00000100:00100000:1.0:1787856015.009985:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c6009c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+11:13880:x1874702464300032:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787856015.010010:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856015.010047:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73fa6fee00/0x516929ca3366e9d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616f45 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856015.010091:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73fa6fee00/0x516929ca3366e9d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f45 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856015.010105:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73fa6fee00/0x516929ca3366e9d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f45 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856015.010118:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fee00, rc 0) 00000100:00100000:1.0:1787856015.010206:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c6009c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+12:13880:x1874702464300032:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 223us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856015.010215:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 95 00000100:00100000:0.0:1787856015.014576:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856015.014816:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464300160 00000100:00100000:2.0:1787856015.014831:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464300160 00000100:00100000:2.0:1787856015.014919:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 96 00000100:00100000:2.0:1787856015.014933:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c600a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+12:13880:x1874702464300160:12345-192.168.201.38@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787856015.014980:0:14354:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787856015.015130:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787856015.015135:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787856015.015139:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787856015.015141:0:14354:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787856015.020394:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c600a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+12:13880:x1874702464300160:12345-192.168.201.38@tcp:256:mount.lustre.0 Request processed in 5445us (5815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856015.020415:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 96 00000100:00100000:0.0:1787856015.024098:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856015.024293:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464300288 00000100:00100000:2.0:1787856015.024307:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464300288 00000100:00100000:2.0:1787856015.024385:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 97 00000100:00100000:2.0:1787856015.024416:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c6009450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+12:13880:x1874702464300288:12345-192.168.201.38@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787856015.024440:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856015.024476:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73d1229800/0x516929ca3366e9e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616f4c expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856015.024515:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1229800/0x516929ca3366e9e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f4c expref: 13 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856015.024528:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73d1229800/0x516929ca3366e9e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f4c expref: 13 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856015.024539:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229800, rc 0) 00000100:00100000:2.0:1787856015.024923:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c6009450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+13:13880:x1874702464300288:12345-192.168.201.38@tcp:101:mount.lustre.0 Request processed in 508us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856015.024932:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 97 00000100:00100000:2.0:1787856015.028442:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856015.028531:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464300416 00000100:00100000:3.0:1787856015.028543:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464300416 00000100:00100000:3.0:1787856015.028625:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 98 00000100:00100000:3.0:1787856015.028636:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c600b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+13:13880:x1874702464300416:12345-192.168.201.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787856015.029952:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c600b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+13:13880:x1874702464300416:12345-192.168.201.38@tcp:501:mount.lustre.0 Request processed in 1307us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856015.029976:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 98 00000100:00100000:2.0:1787856015.033042:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856015.033165:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464300544 00000100:00100000:1.0:1787856015.033180:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464300544 00000100:00100000:1.0:1787856015.033274:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:1.0:1787856015.033287:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c600a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+13:13880:x1874702464300544:12345-192.168.201.38@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787856015.033595:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c600a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+13:13880:x1874702464300544:12345-192.168.201.38@tcp:503:mount.lustre.0 Request processed in 310us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856015.033604:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 99 00000100:00100000:1.0:1787856015.039667:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856015.040086:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464300672 00000100:00100000:3.0:1787856015.040105:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464300672 00000100:00100000:3.0:1787856015.040182:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 100 00000100:00100000:3.0:1787856015.040194:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c6009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+13:13890:x1874702464300672:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787856015.040970:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c6009050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+13:13890:x1874702464300672:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 761us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856015.040995:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 100 00000100:00100000:0.0:1787856015.054848:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856015.055447:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464300800 00000100:00100000:2.0:1787856015.055462:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464300800 00000100:00100000:2.0:1787856015.055555:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 101 00000100:00100000:2.0:1787856015.055568:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c6009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+13:13890:x1874702464300800:12345-192.168.201.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787856015.055985:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c6009850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+13:13890:x1874702464300800:12345-192.168.201.38@tcp:502:llog_process_th.0 Request processed in 417us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856015.055994:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 101 00000100:00100000:2.0:1787856015.067425:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856015.067488:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856015.067525:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856015.067586:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856015.067634:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464301568 00000100:00100000:2.0:1787856015.067647:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464301568 00000100:00100000:2.0:1787856015.067713:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464301440 00000100:00100000:2.0:1787856015.067717:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464301440 00000100:00100000:2.0:1787856015.067738:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:2.0:1787856015.067749:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb674f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2358:x1874702464301568:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787856015.067898:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb674f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2358:x1874702464301568:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 150us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856015.067908:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:2.0:1787856015.067930:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:2.0:1787856015.067937:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df8483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2358:x1874702464301440:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787856015.067964:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df8483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2358:x1874702464301440:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 27us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856015.067970:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:1.0:1787856015.068356:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464300928 00000100:00100000:1.0:1787856015.068363:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464300928 00000100:00100000:1.0:1787856015.068400:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464301312 00000100:00100000:1.0:1787856015.068405:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464301312 00000100:00100000:1.0:1787856015.068446:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:1.0:1787856015.068456:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb6770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:2358:x1874702464301312:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787856015.068509:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb6770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:2358:x1874702464301312:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 55us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856015.068517:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:1.0:1787856015.068533:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:1.0:1787856015.068538:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73cb677840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1874702464300928:12345-192.168.201.38@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787856015.068567:0:14361:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from c263b399-c1aa-429f-9204-78dc9c713772@192.168.201.38@tcp t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:1.0:1787856015.068611:0:14361:0:(genops.c:1385:class_connect()) connect: client c263b399-c1aa-429f-9204-78dc9c713772, cookie 0x516929ca3366e9e7 00000004:00100000:1.0:1787856015.068652:0:14361:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787856015.068849:0:14361:0:(import.c:65:import_set_state_nolock()) ffff9a73eb78c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787856015.068896:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73cb677840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c263b399-c1aa-429f-9204-78dc9c713772+6:2356:x1874702464300928:12345-192.168.201.38@tcp:38:mount.lustre.0 Request processed in 356us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856015.068904:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:2.0:1787856015.082348:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856015.082403:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856015.082527:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464301184 00000100:00100000:0.0:1787856015.082542:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464301184 00000100:00100000:0.0:1787856015.082636:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464301056 00000100:00100000:0.0:1787856015.082641:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464301056 00000100:00100000:0.0:1787856015.082676:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:0.0:1787856015.082687:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df849680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c263b399-c1aa-429f-9204-78dc9c713772+7:13880:x1874702464301184:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787856015.082731:0:14362:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787856015.082884:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df849680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c263b399-c1aa-429f-9204-78dc9c713772+7:13880:x1874702464301184:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 197us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856015.082893:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:0.0:1787856015.082933:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:0.0:1787856015.082940:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c263b399-c1aa-429f-9204-78dc9c713772+6:0:x1874702464301056:12345-192.168.201.38@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787856015.082953:0:14362:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787856015.084895:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c263b399-c1aa-429f-9204-78dc9c713772+6:0:x1874702464301056:12345-192.168.201.38@tcp:41:mount.lustre.0 Request processed in 1938us (2474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856015.084913:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00080000:3.0:1787856015.086268:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856015.086426:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856015.086607:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464301696 00000100:00100000:1.0:1787856015.086637:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464301696 00000100:00100000:1.0:1787856015.086707:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:1.0:1787856015.086720:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c263b399-c1aa-429f-9204-78dc9c713772+6:13880:x1874702464301696:12345-192.168.201.38@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787856015.086860:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c263b399-c1aa-429f-9204-78dc9c713772+6:13880:x1874702464301696:12345-192.168.201.38@tcp:40:mount.lustre.0 Request processed in 142us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856015.086879:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:2.0:1787856015.099796:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856015.099846:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856015.099905:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856015.100319:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464301824 00000100:00100000:3.0:1787856015.100335:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464301824 00000100:00100000:3.0:1787856015.100389:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464301952 00000100:00100000:3.0:1787856015.100392:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464301952 00000100:00100000:3.0:1787856015.100409:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:3.0:1787856015.100420:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1874702464301824:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787856015.100477:0:15044:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from c263b399-c1aa-429f-9204-78dc9c713772@192.168.201.38@tcp t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:3.0:1787856015.100521:0:15044:0:(genops.c:1385:class_connect()) connect: client c263b399-c1aa-429f-9204-78dc9c713772, cookie 0x516929ca3366e9ee 00002000:00100000:3.0:1787856015.100537:0:15044:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c263b399-c1aa-429f-9204-78dc9c713772/ffff9a72c1a64000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787856015.100554:0:15044:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787856015.100953:0:15044:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787856015.101352:0:15044:0:(import.c:65:import_set_state_nolock()) ffff9a72c1a62800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787856015.101460:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c263b399-c1aa-429f-9204-78dc9c713772+6:2356:x1874702464301824:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 1038us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856015.102136:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:3.0:1787856015.102179:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:3.0:1787856015.102188:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1874702464301952:12345-192.168.201.38@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787856015.102223:0:15044:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from c263b399-c1aa-429f-9204-78dc9c713772@192.168.201.38@tcp t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:3.0:1787856015.102264:0:15044:0:(genops.c:1385:class_connect()) connect: client c263b399-c1aa-429f-9204-78dc9c713772, cookie 0x516929ca3366e9f5 00002000:00100000:3.0:1787856015.102279:0:15044:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c263b399-c1aa-429f-9204-78dc9c713772/ffff9a72c1a60800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787856015.102291:0:15044:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787856015.102603:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464302080 00000100:00100000:1.0:1787856015.102632:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464302080 00000100:00100000:1.0:1787856015.102689:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:1.0:1787856015.102698:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c263b399-c1aa-429f-9204-78dc9c713772+6:13880:x1874702464302080:12345-192.168.201.38@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787856015.102995:0:14364:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787856015.103379:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c263b399-c1aa-429f-9204-78dc9c713772+6:13880:x1874702464302080:12345-192.168.201.38@tcp:33:mount.lustre.0 Request processed in 680us (3471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856015.103389:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00002000:00080000:0.0:1787856015.106852:0:15044:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787856015.106936:0:15044:0:(import.c:65:import_set_state_nolock()) ffff9a72c2d90800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787856015.107123:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c263b399-c1aa-429f-9204-78dc9c713772+6:2356:x1874702464301952:12345-192.168.201.38@tcp:8:mount.lustre.0 Request processed in 4931us (7273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856015.107137:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00010000:00010000:1.0:1787856015.228155:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856015.438100:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856015.442026:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464302208 00000100:00100000:0.0:1787856015.442051:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464302208 00000100:00100000:0.0:1787856015.442231:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:0.0:1787856015.442244:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c263b399-c1aa-429f-9204-78dc9c713772+6:13910:x1874702464302208:12345-192.168.201.38@tcp:101:mkdir.0 00010000:00010000:0.0:1787856015.442271:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856015.442303:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e9fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616f76 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856015.442387:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ea03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856015.442405:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ea03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856015.442419:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ea03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856015.444195:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787856015.444208:0:14362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787856015.444349:0:14362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ea03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856015.444404:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366e9fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f76 expref: 8 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856015.444427:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ea03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f76 expref: 7 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856015.444439:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:0.0:1787856015.444442:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787856015.444447:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142400, rc 0) 00000100:00100000:0.0:1787856015.444554:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c263b399-c1aa-429f-9204-78dc9c713772+7:13910:x1874702464302208:12345-192.168.201.38@tcp:101:mkdir.0 Request processed in 2311us (7781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856015.444565:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00010000:00010000:2.0:1787856016.254019:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856017.275987:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787856017.637563:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ae33b44f-c9e3-446c-bea8-6bb64f60aa30 00000001:00100000:0.0:1787856017.637586:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c263b399-c1aa-429f-9204-78dc9c713772 00000100:00100000:1.0:1787856018.046190:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff37be87-90a7-463b-b734-d2f25b77f044:3306:1874702486311680:0@lo:400:kworker.0 00000100:00100000:1.0:1787856018.046283:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856018.046685:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486311680 00000100:00100000:3.0:1787856018.046714:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486311680 00000100:00100000:3.0:1787856018.046798:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787856018.046809:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c6008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+19:3306:x1874702486311680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856018.047124:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c6008450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+19:3306:x1874702486311680:12345-0@lo:400:kworker.0 Request processed in 315us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856018.047132:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787856018.047191:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7420b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486311424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787856018.047222:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856018.047257:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486311424 00000100:00100000:3.0:1787856018.047261:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486311424 00000100:00100000:3.0:1787856018.047306:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787856018.047313:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7444780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486311424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787856018.047360:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787856018.047397:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7444780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486311424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856018.047403:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787856018.047420:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787856018.048822:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7421e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486311552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787856018.048905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856018.049007:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486311552 00000100:00100000:3.0:1787856018.049016:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486311552 00000100:00100000:3.0:1787856018.049073:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787856018.049081:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7446940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486311552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787856018.049119:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787856018.049158:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7446940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486311552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856018.049165:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787856018.049193:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787856018.049260:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7421680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486311808:0@lo:400:kworker.0 00000100:00100000:3.0:1787856018.049291:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856018.049328:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486311808 00000100:00100000:3.0:1787856018.049332:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486311808 00000100:00100000:3.0:1787856018.049361:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787856018.049368:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7446580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486311808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856018.049404:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7446580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874702486311808:12345-0@lo:400:kworker.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856018.049410:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787856018.050765:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff37be87-90a7-463b-b734-d2f25b77f044:3306:1874702486311680:0@lo:400:kworker.0 00000100:00100000:1.0:1787856018.050797:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7422d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486312192:0@lo:400:kworker.0 00000100:00100000:2.0:1787856018.052571:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787856018.052677:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7420b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486311424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787856018.052693:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7422580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486311936:0@lo:400:kworker.0 00000100:00100000:2.0:1787856018.052802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856018.052888:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486311936 00000100:00100000:2.0:1787856018.052897:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486311936 00000100:00100000:2.0:1787856018.054025:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787856018.054041:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486311936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856018.054127:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486311936:12345-0@lo:400:kworker.0 Request processed in 91us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856018.054135:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787856018.054194:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7422580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486311936:0@lo:400:kworker.0 00000100:00100000:2.0:1787856018.054285:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7421e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486311552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787856018.054295:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486312064:0@lo:400:kworker.0 00000100:00100000:2.0:1787856018.054335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856018.054376:0:16043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486312064 00000100:00100000:2.0:1787856018.054381:0:16043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486312064 00000100:00100000:2.0:1787856018.054416:0:16043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787856018.054422:0:16043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486312064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856018.054458:0:16043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874702486312064:12345-0@lo:400:kworker.0 Request processed in 36us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856018.054464:0:16043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787856018.054493:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7421680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486311808:0@lo:400:kworker.0 00000100:00100000:2.0:1787856018.054502:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7420780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486312320:0@lo:400:kworker.0 00000100:00100000:2.0:1787856018.054527:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856018.054572:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874702486312064:0@lo:400:kworker.0 00000100:00100000:1.0:1787856018.055577:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486312320 00000100:00100000:1.0:1787856018.055588:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486312320 00000100:00100000:1.0:1787856018.055667:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787856018.055678:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486312320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856018.055752:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874702486312320:12345-0@lo:400:kworker.0 Request processed in 75us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856018.055771:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787856018.055824:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856018.055858:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7420780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874702486312320:0@lo:400:kworker.0 00000100:00100000:1.0:1787856018.055904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856018.055955:0:16043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486312192 00000100:00100000:1.0:1787856018.055960:0:16043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486312192 00000100:00100000:1.0:1787856018.055991:0:16043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787856018.055997:0:16043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7420780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486312192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856018.056033:0:16043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7420780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874702486312192:12345-0@lo:400:kworker.0 Request processed in 36us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856018.056039:0:16043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787856018.056055:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856018.056071:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7422d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874702486312192:0@lo:400:kworker.0 00000001:00100000:0.0:1787856018.137078:0:7628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c263b399-c1aa-429f-9204-78dc9c713772 00000001:00100000:0.0:1787856018.139697:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c263b399-c1aa-429f-9204-78dc9c713772 00010000:00010000:1.0:1787856018.301080:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787856019.207467:0:16327:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787856019.327248:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856020.348123:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856020.399878:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856020.399997:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464302336 00000100:00100000:1.0:1787856020.400007:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464302336 00000100:00100000:1.0:1787856020.400067:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 103 00000100:00100000:1.0:1787856020.400078:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+13:2357:x1874702464302336:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787856020.400154:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1376850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+13:2357:x1874702464302336:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 77us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856020.400163:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 103 00000100:00100000:2.0:1787856020.415612:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856020.415655:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856020.415752:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464302592 00000100:00100000:3.0:1787856020.415761:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464302592 00000100:00100000:3.0:1787856020.415852:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:3.0:1787856020.415862:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2357:x1874702464302592:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787856020.415928:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2357:x1874702464302592:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 68us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856020.415936:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00080000:3.0:1787856020.415959:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787856020.416452:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856020.416481:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856020.416519:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464303104 00000100:00100000:3.0:1787856020.416524:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464303104 00000100:00100000:3.0:1787856020.416559:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:3.0:1787856020.416566:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c263b399-c1aa-429f-9204-78dc9c713772+5:2357:x1874702464303104:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787856020.416602:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c263b399-c1aa-429f-9204-78dc9c713772+5:2357:x1874702464303104:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 37us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856020.416609:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00080000:3.0:1787856020.416622:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787856020.425730:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464302848 00000100:00100000:0.0:1787856020.425746:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464302848 00000100:00100000:0.0:1787856020.425843:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464302464 00000100:00100000:0.0:1787856020.425848:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464302464 00000100:00100000:0.0:1787856020.425899:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:0.0:1787856020.425911:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c263b399-c1aa-429f-9204-78dc9c713772+6:2357:x1874702464302848:12345-192.168.201.38@tcp:400:kworker.0 00000100:00080000:2.0:1787856020.426031:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787856020.426097:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856020.426114:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:2.0:1787856020.426117:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464302720 00000100:00100000:2.0:1787856020.426120:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464302720 00000100:00100000:3.0:1787856020.426129:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:2357:x1874702464302464:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787856020.426151:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:2.0:1787856020.426156:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2357:x1874702464302720:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787856020.426204:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:2357:x1874702464302464:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 77us (9721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856020.426212:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:2.0:1787856020.428457:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2357:x1874702464302720:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 2289us (2349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856020.428473:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00080000:2.0:1787856020.428511:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856020.429076:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856020.429673:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464302976 00000100:00100000:2.0:1787856020.429683:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464302976 00000100:00100000:2.0:1787856020.429741:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:2.0:1787856020.429751:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c263b399-c1aa-429f-9204-78dc9c713772+5:2357:x1874702464302976:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:2.0:1787856020.429852:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c263b399-c1aa-429f-9204-78dc9c713772+5:2357:x1874702464302976:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 102us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856020.429859:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00080000:2.0:1787856020.430096:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787856020.430681:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c263b399-c1aa-429f-9204-78dc9c713772+6:2357:x1874702464302848:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 4768us (15020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856020.430691:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00010000:00010000:1.0:1787856021.372034:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787856022.396478:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856023.164565:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff37be87-90a7-463b-b734-d2f25b77f044:3304:1874702486312448:0@lo:400:kworker.0 00000100:00100000:0.0:1787856023.164638:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856023.164691:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486312960:0@lo:400:kworker.0 00000100:00100000:0.0:1787856023.164733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856023.164760:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787856023.164767:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486312576:0@lo:400:kworker.0 00000100:00100000:0.0:1787856023.164809:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856023.164830:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486313088:0@lo:400:kworker.0 00000100:00100000:1.0:1787856023.165772:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486312448 00000100:00100000:1.0:1787856023.165804:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486312448 00000100:00100000:1.0:1787856023.165979:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787856023.165989:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+19:3304:x1874702486312448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856023.166052:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+19:3304:x1874702486312448:12345-0@lo:400:kworker.0 Request processed in 65us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856023.166060:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787856023.166347:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856023.166394:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff37be87-90a7-463b-b734-d2f25b77f044:3304:1874702486312448:0@lo:400:kworker.0 00000100:00100000:0.0:1787856023.166427:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486312704:0@lo:400:kworker.0 00000100:00100000:0.0:1787856023.166459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856023.166476:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486313216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787856023.166497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856023.166517:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787856023.166523:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486312832:0@lo:400:kworker.0 00000100:00100000:0.0:1787856023.166546:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856023.166563:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486313344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856023.166581:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856023.166619:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486312960 00000100:00100000:0.0:1787856023.166623:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486312960 00000100:00100000:0.0:1787856023.166655:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486313088 00000100:00100000:0.0:1787856023.166658:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486313088 00000100:00100000:0.0:1787856023.166670:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486312832 00000100:00100000:0.0:1787856023.166672:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486312832 00000100:00100000:0.0:1787856023.166683:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787856023.166690:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486312960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856023.166748:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874702486312960:12345-0@lo:400:kworker.0 Request processed in 58us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856023.166755:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787856023.166768:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787856023.166797:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486313088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856023.169240:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486313088:12345-0@lo:400:kworker.0 Request processed in 2458us (4364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856023.169414:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787856023.169447:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787856023.169459:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486312832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856023.169539:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874702486312832:12345-0@lo:400:kworker.0 Request processed in 85us (2991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856023.169545:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787856023.169568:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486312576 00000100:00100000:0.0:1787856023.169575:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486312576 00000100:00100000:1.0:1787856023.169697:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874702486312832:0@lo:400:kworker.0 00000100:00100000:0.0:1787856023.169858:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486312704 00000100:00100000:0.0:1787856023.169863:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486312704 00000100:00100000:2.0:1787856023.172453:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787856023.172479:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486312576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856023.172564:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e09a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486312576:12345-0@lo:400:kworker.0 Request processed in 97us (7753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856023.172585:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787856023.172610:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787856023.172617:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486312704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787856023.172669:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486312704:12345-0@lo:400:kworker.0 Request processed in 52us (6207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856023.172675:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787856023.173024:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486312704:0@lo:400:kworker.0 00000100:00100000:0.0:1787856023.174881:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486313216 00000100:00100000:0.0:1787856023.174891:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486313216 00000100:00100000:0.0:1787856023.174926:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486313344 00000100:00100000:0.0:1787856023.174929:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486313344 00000100:00100000:0.0:1787856023.174957:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787856023.174965:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486313216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787856023.175004:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787856023.175077:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486313216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (8578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856023.175084:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787856023.175098:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787856023.175104:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1322940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486313344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787856023.175388:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787856023.175427:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1322940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486313344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 323us (8844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856023.175434:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787856023.175463:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787856023.175468:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787856023.175471:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787856023.176094:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486313344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787856023.176113:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486313216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787856023.176444:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486312576:0@lo:400:kworker.0 00000100:00100000:0.0:1787856023.176456:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486313088:0@lo:400:kworker.0 00000100:00100000:0.0:1787856023.176468:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874702486312960:0@lo:400:kworker.0 00000020:00000080:2.0:1787856023.292524:0:16477:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3222e630 20000000:00000080:2.0:1787856023.292544:0:16477:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a72c2822000 uarg=0000000000000000 20000000:01000000:2.0:1787856023.292580:0:16477:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787856023.292586:0:16477:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787856023.292591:0:16477:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787856023.294844:0:16478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1787856023.295071:0:16477:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787856023.307111:0:16477:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787856023.312605:0:16477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366ea0a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.312632:0:16477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73fa6fe600/0x516929ca3366e701 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e6fa expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.312639:0:16477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73f7887c00/0x516929ca3366e74e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e747 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.312646:0:16477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73d1228e00/0x516929ca3366e882 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366e87b expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.312655:0:16477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73c5142e00/0x516929ca3366e9a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616eea expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.312662:0:16477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a73d1229800/0x516929ca3366e9e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f4c expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.312668:0:16477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366ea0a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.312712:0:16477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73d1229800/0x516929ca3366e9e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f4c expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.312752:0:16477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a73d1229800/0x516929ca3366e9e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f4c expref: 12 pid: 14353 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856023.312767:0:16477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7423480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1874702486313472:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787856023.313649:0:16477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73c5142e00/0x516929ca3366e9a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616eea expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.313660:0:16477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a73c5142e00/0x516929ca3366e9a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616eea expref: 12 pid: 14353 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856023.313670:0:16477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7420000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1874702486313600:192.168.201.38@tcp:104: 00010000:00010000:1.0:1787856023.313705:0:16477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73d1228e00/0x516929ca3366e882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366e87b expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.313713:0:16477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a73d1228e00/0x516929ca3366e882 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366e87b expref: 18 pid: 14354 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856023.313734:0:16477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7421680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1874702486313728:0@lo:104: 00000100:00100000:1.0:1787856023.313792:0:16477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787856023.313839:0:16477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73f7887c00/0x516929ca3366e74e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366e747 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.313847:0:16477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a73f7887c00/0x516929ca3366e74e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366e747 expref: 18 pid: 14353 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856023.313856:0:16477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7422580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1874702486313856:0@lo:104: 00000100:00100000:1.0:1787856023.313892:0:16477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787856023.313935:0:16477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a73fa6fe600/0x516929ca3366e701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x516929ca3366e6fa expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.313944:0:16477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a73fa6fe600/0x516929ca3366e701 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x516929ca3366e6fa expref: 18 pid: 14354 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856023.313953:0:16477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a72c2e0b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1874702486313984:0@lo:104: 00000100:00100000:1.0:1787856023.313978:0:16477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856023.313987:0:16477:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d80facc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856023.314381:0:14344:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787856023.314396:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486313728 00000100:00100000:0.0:1787856023.314409:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486313728 00000100:00100000:0.0:1787856023.314460:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486313856 00000100:00100000:0.0:1787856023.314463:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486313856 00000100:00100000:0.0:1787856023.314473:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486313984 00000100:00100000:0.0:1787856023.314476:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486313984 00000100:00100000:0.0:1787856023.314490:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787856023.314498:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7421e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff37be87-90a7-463b-b734-d2f25b77f044+5:16477:x1874702486313728:12345-0@lo:104: 00010000:00010000:0.0:1787856023.314509:0:14344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fec00/0x516929ca3366e87b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366e882 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.314577:0:14344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787856023.314583:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7421e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff37be87-90a7-463b-b734-d2f25b77f044+5:16477:x1874702486313728:12345-0@lo:104: Request processed in 86us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856023.314590:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787856023.314606:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787856023.314612:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7420b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff37be87-90a7-463b-b734-d2f25b77f044+4:16477:x1874702486313856:12345-0@lo:104: 00010000:00010000:0.0:1787856023.314621:0:14344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73c5143c00/0x516929ca3366e747 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366e74e expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.314653:0:14344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787856023.314659:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7420b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff37be87-90a7-463b-b734-d2f25b77f044+4:16477:x1874702486313856:12345-0@lo:104: Request processed in 48us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856023.314664:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787856023.314674:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787856023.314680:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73fa20c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff37be87-90a7-463b-b734-d2f25b77f044+3:16477:x1874702486313984:12345-0@lo:104: 00010000:00010000:0.0:1787856023.314688:0:14344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.138@tcp lock: ffff9a73c166d600/0x516929ca3366e6fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366e701 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.314731:0:14344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787856023.314744:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73fa20c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ff37be87-90a7-463b-b734-d2f25b77f044+3:16477:x1874702486313984:12345-0@lo:104: Request processed in 63us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856023.314749:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787856023.314832:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787856023.314838:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fec00/0x516929ca3366e87b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366e882 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.314845:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fec00 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787856023.314849:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fec00/0x516929ca3366e87b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366e882 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.314857:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fec00/0x516929ca3366e87b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366e882 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787856023.314874:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fec00/0x516929ca3366e87b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366e882 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856023.314880:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787856023.314908:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fec00/0x516929ca3366e87b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e882 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.314915:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787856023.314933:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fec00/0x516929ca3366e87b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e882 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.314939:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73fa6fec00/0x516929ca3366e87b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e882 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.314950:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787856023.314953:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c5143c00/0x516929ca3366e747 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366e74e expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.314967:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143c00 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787856023.314970:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5143c00/0x516929ca3366e747 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366e74e expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.314976:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c5143c00/0x516929ca3366e747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366e74e expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787856023.314981:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c5143c00/0x516929ca3366e747 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366e74e expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856023.314986:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787856023.314999:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c5143c00/0x516929ca3366e747 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e74e expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.315005:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787856023.315011:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c5143c00/0x516929ca3366e747 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e74e expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.315017:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c5143c00/0x516929ca3366e747 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e74e expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.315027:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856023.315030:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.138@tcp lock: ffff9a73c166d600/0x516929ca3366e6fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x516929ca3366e701 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.315035:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c166d600 already unused, calling callback (ffffffffc1c2cc20) 10000000:00010000:0.0:1787856023.315038:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.138@tcp lock: ffff9a73c166d600/0x516929ca3366e6fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x516929ca3366e701 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.315055:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.138@tcp lock: ffff9a73c166d600/0x516929ca3366e6fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x516929ca3366e701 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787856023.315061:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.138@tcp lock: ffff9a73c166d600/0x516929ca3366e6fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x516929ca3366e701 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787856023.315065:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787856023.315078:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.138@tcp lock: ffff9a73c166d600/0x516929ca3366e6fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e701 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.315084:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787856023.315097:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.138@tcp lock: ffff9a73c166d600/0x516929ca3366e6fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e701 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.315104:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.138@tcp lock: ffff9a73c166d600/0x516929ca3366e6fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x516929ca3366e701 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.315118:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856023.315120:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856023.315121:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856023.315128:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856023.315132:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787856023.315144:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1322580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff37be87-90a7-463b-b734-d2f25b77f044:3304:1874702486314112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787856023.315174:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856023.316731:0:16477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7421680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1874702486313728:0@lo:104: 00000100:00100000:2.0:1787856023.316746:0:16477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7422580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1874702486313856:0@lo:104: 00000100:00100000:2.0:1787856023.316755:0:16477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a72c2e0b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1874702486313984:0@lo:104: 00000100:00100000:2.0:1787856023.316812:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d13212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff37be87-90a7-463b-b734-d2f25b77f044:3306:1874702486314368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787856023.316852:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856023.316952:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486314112 00000100:00100000:1.0:1787856023.316957:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486314112 00010000:00010000:1.0:1787856023.316980:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73d1228e00/0x516929ca3366e882 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366e87b expref: 19 pid: 14354 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856023.316999:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486314368 00000100:00100000:1.0:1787856023.317000:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486314368 00010000:00010000:1.0:1787856023.317006:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73fa6fe600/0x516929ca3366e701 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366e6fa expref: 20 pid: 14354 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856023.317015:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787856023.317019:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1323c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff37be87-90a7-463b-b734-d2f25b77f044+20:3304:x1874702486314112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787856023.317028:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856023.317032:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73d1228e00/0x516929ca3366e882 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366e87b expref: 20 pid: 14354 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.317038:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73d1228e00/0x516929ca3366e882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366e87b expref: 20 pid: 14354 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.317051:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73d1228e00/0x516929ca3366e882 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366e87b expref: 20 pid: 14354 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.317073:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856023.317097:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1323c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff37be87-90a7-463b-b734-d2f25b77f044+19:3304:x1874702486314112:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856023.317104:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787856023.317120:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787856023.317126:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff37be87-90a7-463b-b734-d2f25b77f044+18:3306:x1874702486314368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787856023.317133:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856023.317138:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73fa6fe600/0x516929ca3366e701 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366e6fa expref: 18 pid: 14354 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.317146:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73fa6fe600/0x516929ca3366e701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366e6fa expref: 18 pid: 14354 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.317156:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73fa6fe600/0x516929ca3366e701 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366e6fa expref: 18 pid: 14354 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.317164:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856023.317185:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ff37be87-90a7-463b-b734-d2f25b77f044+17:3306:x1874702486314368:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856023.317191:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787856023.329572:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856023.329652:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856023.329678:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464303360 00000100:00100000:1.0:1787856023.329686:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464303360 00010000:00010000:1.0:1787856023.329733:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73c5142e00/0x516929ca3366e9a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616eea expref: 13 pid: 14353 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856023.329756:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464303232 00000100:00100000:1.0:1787856023.329772:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464303232 00010000:00010000:1.0:1787856023.329815:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73d1229800/0x516929ca3366e9e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f4c expref: 14 pid: 14353 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856023.329830:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:1.0:1787856023.329838:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc66c119-c344-45de-bbb7-cac8e3170df7+14:2357:x1874702464303360:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856023.329851:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856023.329856:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73c5142e00/0x516929ca3366e9a8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616eea expref: 14 pid: 14353 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.329875:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73c5142e00/0x516929ca3366e9a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616eea expref: 14 pid: 14353 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.329894:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856023.329940:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2ee9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc66c119-c344-45de-bbb7-cac8e3170df7+14:2357:x1874702464303360:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 102us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856023.329948:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:1.0:1787856023.329992:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:1.0:1787856023.329999:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e0a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc66c119-c344-45de-bbb7-cac8e3170df7+13:2357:x1874702464303232:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856023.330006:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856023.330009:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73d1229800/0x516929ca3366e9e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f4c expref: 13 pid: 14353 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.330018:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73d1229800/0x516929ca3366e9e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f4c expref: 13 pid: 14353 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856023.330027:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856023.330043:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e0a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dc66c119-c344-45de-bbb7-cac8e3170df7+13:2357:x1874702464303232:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 45us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856023.330055:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:0.0:1787856023.331541:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1322580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff37be87-90a7-463b-b734-d2f25b77f044:3304:1874702486314112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787856023.331570:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856023.331583:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d13221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff37be87-90a7-463b-b734-d2f25b77f044:3304:1874702486314240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787856023.331761:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856023.331850:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486314240 00000100:00100000:0.0:1787856023.331857:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486314240 00010000:00010000:0.0:1787856023.331965:0:14347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a73f7887c00/0x516929ca3366e74e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366e747 expref: 17 pid: 14353 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856023.331996:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787856023.332004:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1322580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff37be87-90a7-463b-b734-d2f25b77f044+17:3304:x1874702486314240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787856023.332018:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856023.332023:0:14347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a73f7887c00/0x516929ca3366e74e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x516929ca3366e747 expref: 17 pid: 14353 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.332035:0:14347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a73f7887c00/0x516929ca3366e74e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x516929ca3366e747 expref: 17 pid: 14353 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.332051:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73f7887c00/0x516929ca3366e74e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x516929ca3366e747 expref: 17 pid: 14353 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.332067:0:14347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366ea0a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.332076:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366ea0a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.332583:0:14347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366ea0a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.332594:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366ea0a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.332601:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366ea0a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.332701:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366ea0a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.332707:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856023.332711:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366ea0a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.332728:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366ea0a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.332739:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366ea0a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.332749:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856023.332823:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1322580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ff37be87-90a7-463b-b734-d2f25b77f044+16:3304:x1874702486314240:12345-0@lo:103:ldlm_bl.0 Request processed in 817us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856023.332831:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787856023.332971:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d13221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff37be87-90a7-463b-b734-d2f25b77f044:3304:1874702486314240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787856023.333335:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d13212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ff37be87-90a7-463b-b734-d2f25b77f044:3306:1874702486314368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787856023.334186:0:16477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73d1229800/0x516929ca3366e9e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f4c expref: 12 pid: 14353 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856023.334203:0:16477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7423480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1874702486313472:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787856023.334216:0:16477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73c5142e00/0x516929ca3366e9a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616eea expref: 11 pid: 14353 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856023.334224:0:16477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7420000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1874702486313600:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787856023.334623:0:16477:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366ea0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.334648:0:16477:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366ea0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.334654:0:16477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366ea0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856023.334661:0:16477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a73fa6ff000/0x516929ca3366ea0a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856023.436064:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856024.445032:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787856024.677713:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856024.680486:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464303488 00000100:00100000:3.0:1787856024.680503:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464303488 00000100:00100000:3.0:1787856024.680558:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 105 00000100:00100000:3.0:1787856024.680567:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+11:13764:x1874702464303488:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787856024.680584:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856024.680605:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a72c337f000/0x516929ca3366ea11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616f7d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856024.680633:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a72c337f000/0x516929ca3366ea11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f7d expref: 12 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856024.680644:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a72c337f000/0x516929ca3366ea11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f7d expref: 12 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856024.680654:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a72c337f000, rc 0) 00000100:00100000:3.0:1787856024.680729:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+12:13764:x1874702464303488:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 160us (3035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856024.680737:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 105 00000100:00100000:0.0:1787856024.700453:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856024.700491:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464303616 00000100:00100000:0.0:1787856024.700500:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464303616 00000100:00100000:0.0:1787856024.700541:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 106 00000100:00100000:0.0:1787856024.700550:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+12:13764:x1874702464303616:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787856024.700940:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+12:13764:x1874702464303616:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 389us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856024.700948:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 106 00000100:00100000:3.0:1787856024.718278:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856024.718316:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464303744 00000100:00100000:3.0:1787856024.718325:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464303744 00000100:00100000:3.0:1787856024.718383:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 107 00000100:00100000:3.0:1787856024.718403:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+12:13764:x1874702464303744:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787856024.718620:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+12:13764:x1874702464303744:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 219us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856024.718628:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 107 00000100:00100000:0.0:1787856024.733275:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856024.733351:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464303872 00000100:00100000:3.0:1787856024.733361:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464303872 00000100:00100000:3.0:1787856024.733423:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 108 00000100:00100000:3.0:1787856024.733434:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+12:13764:x1874702464303872:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787856024.733451:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856024.733470:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a72c337f200/0x516929ca3366ea18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbbc00c930616f84 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856024.733500:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a72c337f200/0x516929ca3366ea18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f84 expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856024.733512:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a72c337f200/0x516929ca3366ea18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f84 expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856024.733522:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a72c337f200, rc 0) 00000100:00100000:3.0:1787856024.733584:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+13:13764:x1874702464303872:12345-192.168.201.38@tcp:101:ll_cfg_requeue.0 Request processed in 152us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856024.733591:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 108 00000100:00100000:0.0:1787856024.745372:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856024.748656:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464304000 00000100:00100000:1.0:1787856024.748672:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464304000 00000100:00100000:1.0:1787856024.748732:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 109 00000100:00100000:1.0:1787856024.748742:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+13:13764:x1874702464304000:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787856024.749049:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+13:13764:x1874702464304000:12345-192.168.201.38@tcp:501:ll_cfg_requeue.0 Request processed in 309us (3685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856024.749055:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 109 00000100:00100000:2.0:1787856024.756390:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856024.756462:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464304128 00000100:00100000:3.0:1787856024.756472:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464304128 00000100:00100000:3.0:1787856024.756528:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 110 00000100:00100000:3.0:1787856024.756538:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+13:13764:x1874702464304128:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787856024.756816:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1212c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc66c119-c344-45de-bbb7-cac8e3170df7+13:13764:x1874702464304128:12345-192.168.201.38@tcp:503:ll_cfg_requeue.0 Request processed in 279us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856024.756826:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 110 10000000:01000000:3.0:1787856024.766202:0:14357:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787856024.766211:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a72c1323800 from 10 10000000:01000000:3.0:1787856024.766217:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787856024.766266:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a72c337f600/0x516929ca3366ea1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856024.766277:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a72c337f600/0x516929ca3366ea1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856024.766287:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a72c337f600/0x516929ca3366ea1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856024.766311:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7445680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486314496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787856024.766379:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856024.766436:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787856024.766636:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486314496 00000100:00100000:2.0:1787856024.766643:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486314496 00000100:00100000:2.0:1787856024.766705:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787856024.766714:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+16:14357:x1874702486314496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856024.766726:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856024.766746:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73d1229c00/0x516929ca3366ea26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366ea1f expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856024.766769:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73d1229c00/0x516929ca3366ea26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366ea1f expref: 17 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856024.766822:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73d1229c00/0x516929ca3366ea26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366ea1f expref: 17 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856024.766830:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229c00, rc 0) 00000100:00100000:2.0:1787856024.766869:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+17:14357:x1874702486314496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856024.766876:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787856024.767040:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7445680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486314496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787856024.767055:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a72c337f600/0x516929ca3366ea1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366ea26 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856024.767064:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a72c337f600/0x516929ca3366ea1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366ea26 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856024.767122:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7445680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486314624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787856024.767149:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856024.767170:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856024.767184:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486314624 00000100:00100000:3.0:1787856024.767187:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486314624 00000100:00100000:3.0:1787856024.767211:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787856024.767217:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+17:14357:x1874702486314624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787856024.767449:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+17:14357:x1874702486314624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856024.767456:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787856024.767483:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7445680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486314624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787856024.767511:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e7445680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486314752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787856024.767550:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856024.767564:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c2bc0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787856024.767576:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486314752 00000100:00100000:3.0:1787856024.767579:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486314752 00000100:00100000:3.0:1787856024.767597:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787856024.767602:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+17:14357:x1874702486314752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787856024.767749:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+17:14357:x1874702486314752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856024.767756:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787856024.767942:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e7445680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486314752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787856024.772609:0:16545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787856024.772907:0:14357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787856024.772930:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787856024.772941:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a72c337f600/0x516929ca3366ea1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366ea26 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856024.772951:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a72c337f600/0x516929ca3366ea1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366ea26 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856024.772962:0:14357:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787856024.772964:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73d8173000 from 10 10000000:01000000:2.0:1787856024.772967:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787856024.773000:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366ea2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856024.773008:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366ea2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856024.773019:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366ea2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856024.773051:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486314880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787856024.773115:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856024.773183:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9983c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787856024.773223:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486314880 00000100:00100000:3.0:1787856024.773229:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486314880 00000100:00100000:3.0:1787856024.773309:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787856024.773318:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+17:14357:x1874702486314880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787856024.773330:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856024.773345:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a72c337f400/0x516929ca3366ea34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366ea2d expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856024.773367:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a72c337f400/0x516929ca3366ea34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366ea2d expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856024.773376:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a72c337f400/0x516929ca3366ea34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366ea2d expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856024.773385:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a72c337f400, rc 0) 00000100:00100000:3.0:1787856024.773466:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1212450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ff37be87-90a7-463b-b734-d2f25b77f044+18:14357:x1874702486314880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856024.773472:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787856024.773550:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486314880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856024.773563:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366ea2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366ea34 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856024.773571:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366ea2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366ea34 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856024.773621:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486315008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856024.773648:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856024.773669:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9983c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856024.773726:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486315008 00000100:00100000:0.0:1787856024.773732:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486315008 00000100:00100000:0.0:1787856024.773765:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787856024.773923:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+18:14357:x1874702486315008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787856024.774161:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1210050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+18:14357:x1874702486315008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 388us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856024.774177:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787856024.774250:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486315008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856024.774276:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486315136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856024.774308:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856024.774336:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9983c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787856024.774377:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486315136 00000100:00100000:1.0:1787856024.774382:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486315136 00000100:00100000:1.0:1787856024.774411:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787856024.774417:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+18:14357:x1874702486315136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787856024.774556:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1210450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+18:14357:x1874702486315136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856024.774562:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787856024.774672:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486315136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787856024.775555:0:16546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787856024.775724:0:14357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787856024.775745:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787856024.775755:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366ea2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366ea34 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856024.775767:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73d1229e00/0x516929ca3366ea2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366ea34 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787856024.775893:0:14357:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787856024.775896:0:14357:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a73f9d8a000 from 10 10000000:01000000:2.0:1787856024.775899:0:14357:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787856024.775926:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366ea3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856024.775934:0:14357:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366ea3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856024.775944:0:14357:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366ea3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856024.775965:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486315264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787856024.776014:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856024.776045:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9983c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856024.776115:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486315264 00000100:00100000:0.0:1787856024.776122:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486315264 00000100:00100000:0.0:1787856024.776167:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787856024.776177:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+18:14357:x1874702486315264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787856024.776187:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856024.776199:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a73c5143c00/0x516929ca3366ea42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x516929ca3366ea3b expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856024.776222:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a73c5143c00/0x516929ca3366ea42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x516929ca3366ea3b expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856024.776231:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a73c5143c00/0x516929ca3366ea42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x516929ca3366ea3b expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856024.776240:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143c00, rc 0) 00000100:00100000:0.0:1787856024.776277:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1211050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+19:14357:x1874702486315264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856024.776283:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787856024.776423:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486315264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787856024.776436:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366ea3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366ea42 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856024.776444:0:14357:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366ea3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x516929ca3366ea42 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856024.776486:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486315392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856024.776511:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856024.776526:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856024.776539:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486315392 00000100:00100000:2.0:1787856024.776543:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486315392 00000100:00100000:2.0:1787856024.776569:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787856024.776576:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+19:14357:x1874702486315392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787856024.777291:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff37be87-90a7-463b-b734-d2f25b77f044+19:14357:x1874702486315392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 713us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856024.777300:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787856024.777361:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486315392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787856024.777390:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486315520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787856024.777427:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787856024.777489:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa9983c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787856024.777523:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486315520 00000100:00100000:0.0:1787856024.777527:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486315520 00000100:00100000:0.0:1787856024.777585:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787856024.777592:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c54dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+19:14357:x1874702486315520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787856024.777818:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c54dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+19:14357:x1874702486315520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 226us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856024.777831:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787856024.778007:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ff37be87-90a7-463b-b734-d2f25b77f044:14357:1874702486315520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787856024.778939:0:16547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787856024.779130:0:14357:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787856024.779148:0:14357:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787856024.779158:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366ea3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366ea42 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856024.779169:0:14357:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.138@tcp lock: ffff9a73d1229400/0x516929ca3366ea3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x516929ca3366ea42 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787856024.958419:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787856025.469095:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856025.514107:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856025.514157:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856025.514181:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856025.514199:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856025.514218:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856025.514236:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856025.514258:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856025.514287:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464304512 00000100:00100000:1.0:1787856025.514299:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464304512 00000100:00100000:1.0:1787856025.514382:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464305024 00000100:00100000:1.0:1787856025.514385:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464305024 00000100:00100000:1.0:1787856025.514399:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464304640 00000100:00100000:1.0:1787856025.514402:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464304640 00000100:00100000:1.0:1787856025.514415:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464304896 00000100:00100000:1.0:1787856025.514417:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464304896 00000100:00100000:1.0:1787856025.514435:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:1.0:1787856025.514447:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2358:x1874702464304512:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787856025.514553:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2358:x1874702464304512:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 107us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856025.514562:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:1.0:1787856025.514584:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:1.0:1787856025.514591:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c263b399-c1aa-429f-9204-78dc9c713772+5:2358:x1874702464305024:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787856025.514616:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c263b399-c1aa-429f-9204-78dc9c713772+5:2358:x1874702464305024:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856025.514623:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:1.0:1787856025.514636:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:1.0:1787856025.514642:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2358:x1874702464304640:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787856025.514665:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2358:x1874702464304640:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 22us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856025.514671:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:1.0:1787856025.514693:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:1.0:1787856025.514700:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c263b399-c1aa-429f-9204-78dc9c713772+5:2358:x1874702464304896:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787856025.514724:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c263b399-c1aa-429f-9204-78dc9c713772+5:2358:x1874702464304896:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 24us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856025.514740:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:1.0:1787856025.514762:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464304768 00000100:00100000:1.0:1787856025.514766:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464304768 00000100:00100000:3.0:1787856025.514927:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464304256 00000100:00100000:3.0:1787856025.514933:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464304256 00000100:00100000:3.0:1787856025.514967:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:3.0:1787856025.514974:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+13:2358:x1874702464304256:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787856025.515004:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3302450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc66c119-c344-45de-bbb7-cac8e3170df7+13:2358:x1874702464304256:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 31us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856025.515011:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 120 00000100:00100000:1.0:1787856025.517169:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464304384 00000100:00100000:1.0:1787856025.517185:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464304384 00000100:00100000:3.0:1787856025.524622:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:1.0:1787856025.525003:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:1.0:1787856025.525020:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:2358:x1874702464304384:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787856025.527818:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:2358:x1874702464304384:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 2790us (13582us total) trans 0 rc 0/0 00000100:00080000:0.0:1787856025.527957:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787856025.527967:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787856025.527970:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787856025.528051:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:3.0:1787856025.528312:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2e083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c263b399-c1aa-429f-9204-78dc9c713772+6:2358:x1874702464304768:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787856025.528410:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2e083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c263b399-c1aa-429f-9204-78dc9c713772+6:2358:x1874702464304768:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 3756us (14228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856025.528417:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00010000:00010000:2.0:1787856026.491983:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856026.662898:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856026.663356:0:16043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464305152 00000100:00100000:0.0:1787856026.663371:0:16043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464305152 00000100:00100000:0.0:1787856026.663573:0:16043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:0.0:1787856026.663587:0:16043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:14421:x1874702464305152:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787856026.663626:0:16043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856026.663757:0:16043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ea49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616f8b expref: -99 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.663882:0:16043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ea50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.663899:0:16043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ea50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.663925:0:16043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ea50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.663944:0:16043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.663952:0:16043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.663959:0:16043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.665930:0:16043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366ea5e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.665962:0:16043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366ea5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.665977:0:16043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366ea5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856026.666084:0:16043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787856026.666088:0:16043:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787856026.666561:0:16043:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366ea5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666579:0:16043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ea50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666586:0:16043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ea50 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666595:0:16043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ea50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666601:0:16043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787856026.666606:0:16043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ea50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666614:0:16043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ea50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666629:0:16043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:0.0:1787856026.666639:0:16043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856026.666823:0:16043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ea50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666832:0:16043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ea50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666850:0:16043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666857:0:16043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666863:0:16043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666868:0:16043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787856026.666871:0:16043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666877:0:16043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666885:0:16043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a73f49fb300) 00010000:00010000:0.0:1787856026.666888:0:16043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856026.666891:0:16043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666897:0:16043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666947:0:16043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ea49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f8b expref: 8 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666978:0:16043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142800/0x516929ca3366ea5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f8b expref: 7 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.666986:0:16043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a73f49fbc00) 00010000:00010000:0.0:1787856026.666989:0:16043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787856026.666992:0:16043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142800, rc 0) 00000100:00100000:0.0:1787856026.667498:0:16043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:14421:x1874702464305152:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 3908us (4610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856026.667511:0:16043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:3.0:1787856026.670147:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856026.670992:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464305408 00000100:00100000:1.0:1787856026.671057:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464305408 00000100:00100000:1.0:1787856026.671143:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:1.0:1787856026.671155:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:14421:x1874702464305408:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787856026.671519:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856026.671554:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366ea65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616f92 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.671830:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366ea6c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.671849:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366ea6c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.671864:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366ea6c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.672070:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff600/0x516929ca3366ea73 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.672095:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff600/0x516929ca3366ea73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.672108:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff600/0x516929ca3366ea73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.672702:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366ea7a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.672714:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366ea7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.672722:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366ea7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856026.672735:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787856026.673077:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366ea6c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.673086:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366ea6c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.673093:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366ea6c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.673099:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787856026.673103:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366ea6c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.673120:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366ea6c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.673134:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a73f49fbc00) 00010000:00010000:1.0:1787856026.673137:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856026.673143:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366ea6c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.673150:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366ea6c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.673163:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff600/0x516929ca3366ea73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.673183:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff600/0x516929ca3366ea73 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.673190:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff600/0x516929ca3366ea73 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.673195:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787856026.673198:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff600/0x516929ca3366ea73 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.673205:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff600/0x516929ca3366ea73 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.673212:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a73c8d1d300) 00010000:00010000:1.0:1787856026.673214:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856026.673217:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff600/0x516929ca3366ea73 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.673233:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff600/0x516929ca3366ea73 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.673632:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366ea65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f92 expref: 10 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.673648:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe800/0x516929ca3366ea7a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f92 expref: 9 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.673656:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a73c8d1d700) 00010000:00010000:1.0:1787856026.673659:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856026.673672:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe800, rc 0) 00000100:00100000:1.0:1787856026.673759:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+9:14421:x1874702464305408:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 2605us (3627us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787856026.673769:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:2.0:1787856026.678546:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856026.678738:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464305536 00000100:00100000:1.0:1787856026.678747:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464305536 00000100:00100000:1.0:1787856026.679051:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:1.0:1787856026.679064:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+9:14421:x1874702464305536:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787856026.679188:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+9:14421:x1874702464305536:12345-192.168.201.38@tcp:59:lhsmtool_posix.0 Request processed in 126us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856026.679195:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:0.0:1787856026.734913:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856026.735249:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464305664 00000100:00100000:3.0:1787856026.735261:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464305664 00000100:00100000:3.0:1787856026.735324:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:3.0:1787856026.735335:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1323840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+9:14427:x1874702464305664:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787856026.735361:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856026.735387:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e400/0x516929ca3366ea88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616f99 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.735461:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366ea8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.735477:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366ea8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.735490:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366ea8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.735506:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ea96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.735514:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ea96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.735521:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ea96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736107:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366ea8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736117:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366ea8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736125:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366ea8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736131:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337e000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787856026.736135:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366ea8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736143:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366ea8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736157:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:3.0:1787856026.736160:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856026.736164:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366ea8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736170:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366ea8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736182:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ea96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736187:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ea96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736192:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ea96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736204:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337f800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787856026.736207:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ea96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736213:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ea96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736222:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a73cb5a9800) 00010000:00010000:3.0:1787856026.736225:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856026.736227:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ea96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736234:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ea96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736269:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e400/0x516929ca3366ea88 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f99 expref: 10 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736279:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:3.0:1787856026.736281:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856026.736285:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e400/0x516929ca3366ea88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f99 expref: 10 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.736295:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a72c337e400, rc 0) 00000100:00100000:3.0:1787856026.736402:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1323840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+9:14427:x1874702464305664:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1068us (1498us total) trans 0 rc 301/301 00000100:00100000:3.0:1787856026.736412:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:3.0:1787856026.742055:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856026.742198:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464305792 00000100:00100000:1.0:1787856026.742209:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464305792 00000100:00100000:1.0:1787856026.742275:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1787856026.742286:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+9:14427:x1874702464305792:12345-192.168.201.38@tcp:700:lfs.0 00000100:00100000:1.0:1787856026.742387:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+9:14427:x1874702464305792:12345-192.168.201.38@tcp:700:lfs.0 Request processed in 102us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856026.742396:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:2.0:1787856026.744251:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856026.744349:0:16043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464306048 00000100:00100000:0.0:1787856026.744357:0:16043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464306048 00000100:00100000:0.0:1787856026.744448:0:16043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:0.0:1787856026.744457:0:16043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+9:14427:x1874702464306048:12345-192.168.201.38@tcp:36:lfs.0 00010000:00010000:0.0:1787856026.744508:0:16043:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856026.744532:0:16043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366e9cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f14 expref: 9 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.744561:0:16043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:0.0:1787856026.744566:0:16043:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787856026.744903:0:16043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.744918:0:16043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ea03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f76 expref: 5 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.744939:0:16043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea9d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.744973:0:16043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ea03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f76 expref: 5 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.744988:0:16043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ea03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f76 expref: 5 pid: 14362 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856026.745004:0:16043:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1320000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16043:1874702486315648:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787856026.745089:0:16043:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bda80 going to sleep for 11 seconds 00000100:00100000:2.0:1787856026.746718:0:16043:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1320000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16043:1874702486315648:192.168.201.38@tcp:104: 00010000:00010000:2.0:1787856026.746749:0:16043:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856026.747315:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856026.747386:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464306176 00000100:00100000:0.0:1787856026.747394:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464306176 00010000:00010000:0.0:1787856026.747435:0:14347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ea03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f76 expref: 6 pid: 14362 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856026.747476:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:0.0:1787856026.747487:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c263b399-c1aa-429f-9204-78dc9c713772+6:2358:x1874702464306176:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856026.747501:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856026.747508:0:14347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ea03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f76 expref: 6 pid: 14362 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.747520:0:14347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ea03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f76 expref: 6 pid: 14362 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.747542:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ea03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616f76 expref: 6 pid: 14362 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.747583:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:0.0:1787856026.747588:0:14347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.747597:0:14347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.747604:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea9d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.747633:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856026.747699:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c263b399-c1aa-429f-9204-78dc9c713772+5:2358:x1874702464306176:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 213us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856026.747707:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00010000:00010000:2.0:1787856026.747767:0:16043:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.747806:0:16043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.747842:0:16043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366eaa4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.747852:0:16043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366eaa4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.747871:0:16043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366eaa4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856026.749224:0:16043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787856026.749240:0:16043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.749249:0:16043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea9d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.749256:0:16043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.749262:0:16043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787856026.749267:0:16043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.749274:0:16043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea9d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.749291:0:16043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c7093900) 00010000:00010000:2.0:1787856026.749294:0:16043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856026.749298:0:16043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea9d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.749304:0:16043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142200/0x516929ca3366ea9d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787856026.749324:0:16043:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000810eed7e reply state 00000000c00918ac transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366eaa4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856026.749345:0:16043:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787856026.749432:0:16043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+10:14427:x1874702464306048:12345-192.168.201.38@tcp:36:lfs.0 Request processed in 4972us (5184us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787856026.749441:0:16043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00010000:00010000:3.0:1787856026.753514:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366eaa4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.753533:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366eaa4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.753542:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366eaa4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.753549:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787856026.753767:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366eaa4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.754199:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366eaa4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.754222:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a73c7093d00) 00010000:00010000:3.0:1787856026.754225:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856026.754231:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366eaa4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.754237:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366eaa4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856026.822308:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856026.822436:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464306304 00000100:00100000:1.0:1787856026.822447:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464306304 00000100:00100000:1.0:1787856026.822510:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:1.0:1787856026.822522:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+9:14435:x1874702464306304:12345-192.168.201.38@tcp:101:lctl.0 00010000:00010000:1.0:1787856026.822551:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856026.822588:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366eaab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616fa0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.822760:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff600/0x516929ca3366eab2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.822972:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff600/0x516929ca3366eab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.822986:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff600/0x516929ca3366eab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856026.823050:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787856026.823054:0:14361:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787856026.823096:0:14361:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff600/0x516929ca3366eab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.823124:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366eaab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fa0 expref: 11 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.823144:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff600/0x516929ca3366eab2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fa0 expref: 10 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.823175:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c8d1d300) 00010000:00010000:1.0:1787856026.823177:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787856026.823181:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ff600, rc 0) 00000100:00100000:1.0:1787856026.823256:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+10:14435:x1874702464306304:12345-192.168.201.38@tcp:101:lctl.0 Request processed in 735us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856026.823265:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:3.0:1787856026.856265:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856026.856735:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464306432 00000100:00100000:1.0:1787856026.856745:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464306432 00000100:00100000:1.0:1787856026.856957:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:1.0:1787856026.856968:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c263b399-c1aa-429f-9204-78dc9c713772+5:14436:x1874702464306432:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787856026.856989:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856026.857012:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366eab9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616fa7 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.857082:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366eac0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.857096:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366eac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.857108:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366eac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856026.857167:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787856026.857171:0:14362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787856026.857196:0:14362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366eac0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.857243:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366eab9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fa7 expref: 7 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.857260:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe000/0x516929ca3366eac0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fa7 expref: 6 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.857268:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c8d1d300) 00010000:00010000:1.0:1787856026.857271:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787856026.857274:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe000, rc 0) 00000100:00100000:1.0:1787856026.857342:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c263b399-c1aa-429f-9204-78dc9c713772+6:14436:x1874702464306432:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 376us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856026.857349:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:2.0:1787856026.862223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856026.862431:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464306560 00000100:00100000:1.0:1787856026.862443:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464306560 00000100:00100000:1.0:1787856026.862509:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:1.0:1787856026.862521:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c263b399-c1aa-429f-9204-78dc9c713772+6:14436:x1874702464306560:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787856026.862546:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856026.862583:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366eac7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616fae expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.862671:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eace lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.862687:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eace lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.862698:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eace lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.862734:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ead5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.862742:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ead5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.862748:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ead5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.862937:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff000/0x516929ca3366eadc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.862947:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff000/0x516929ca3366eadc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.862953:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff000/0x516929ca3366eadc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856026.862995:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787856026.863314:0:14361:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787856026.863344:0:14361:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff000/0x516929ca3366eadc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863356:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eace lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863362:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eace lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863368:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eace lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863385:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787856026.863389:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eace lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863397:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eace lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863411:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c8d1d300) 00010000:00010000:1.0:1787856026.863414:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856026.863418:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eace lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863424:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eace lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863436:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ead5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863442:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ead5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863447:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ead5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863451:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fec00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787856026.863454:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ead5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863459:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ead5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863476:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a73c8d1d800) 00010000:00010000:1.0:1787856026.863479:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856026.863482:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ead5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863488:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ead5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863520:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366eac7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fae expref: 8 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863533:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff000/0x516929ca3366eadc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fae expref: 7 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.863540:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a73c8d1d000) 00010000:00010000:1.0:1787856026.863541:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787856026.863543:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ff000, rc 0) 00000100:00100000:1.0:1787856026.865800:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c263b399-c1aa-429f-9204-78dc9c713772+7:14436:x1874702464306560:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 3255us (3561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856026.865812:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:3.0:1787856026.877221:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856026.877384:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464306816 00000100:00100000:1.0:1787856026.877394:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464306816 00000100:00100000:1.0:1787856026.877459:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:1.0:1787856026.877469:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7447840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c263b399-c1aa-429f-9204-78dc9c713772+7:14436:x1874702464306816:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787856026.877489:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856026.877509:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366eae3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616fb5 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856026.877677:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787856026.877852:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366eae3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fb5 expref: 9 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.877867:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c8d1d300) 00010000:00010000:1.0:1787856026.877870:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787856026.877876:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366eae3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fb5 expref: 9 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.877890:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe200, rc 0) 00000100:00100000:1.0:1787856026.877943:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7447840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c263b399-c1aa-429f-9204-78dc9c713772+8:14436:x1874702464306816:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 475us (731us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787856026.877950:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 23 00000100:00100000:2.0:1787856026.888414:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856026.888969:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464307072 00000100:00100000:3.0:1787856026.888979:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464307072 00000100:00100000:3.0:1787856026.889053:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:3.0:1787856026.889063:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9df83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c263b399-c1aa-429f-9204-78dc9c713772+8:14436:x1874702464307072:12345-192.168.201.38@tcp:36:lfs.0 00010000:00010000:3.0:1787856026.889120:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856026.889159:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff000/0x516929ca3366eadc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fae expref: 8 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.889177:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a73c8d1d000) 00010000:00010000:3.0:1787856026.889189:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787856026.889215:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e400/0x516929ca3366eaf1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.889228:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e400/0x516929ca3366eaf1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.889239:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e400/0x516929ca3366eaf1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787856026.889481:0:14360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d8b7632 reply state 0000000012047c7a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e400/0x516929ca3366eaf1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856026.889491:0:14360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787856026.889504:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787856026.889741:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9df83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c263b399-c1aa-429f-9204-78dc9c713772+9:14436:x1874702464307072:12345-192.168.201.38@tcp:36:lfs.0 Request processed in 678us (1336us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787856026.889749:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 24 00000100:00100000:2.0:1787856026.893200:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856026.893308:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464307328 00000100:00100000:0.0:1787856026.893319:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464307328 00000100:00100000:0.0:1787856026.893378:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:0.0:1787856026.893391:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c263b399-c1aa-429f-9204-78dc9c713772+9:14436:x1874702464307328:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:0.0:1787856026.893680:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c263b399-c1aa-429f-9204-78dc9c713772+10:14436:x1874702464307328:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 290us (489us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787856026.893689:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00010000:00010000:1.0:1787856026.893920:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e400/0x516929ca3366eaf1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.893933:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e400/0x516929ca3366eaf1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.893940:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e400/0x516929ca3366eaf1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.893947:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337e400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787856026.893951:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e400/0x516929ca3366eaf1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.893958:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e400/0x516929ca3366eaf1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.894005:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a73cb5a9800) 00010000:00010000:1.0:1787856026.894009:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787856026.894015:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e400/0x516929ca3366eaf1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.894022:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e400/0x516929ca3366eaf1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856026.898188:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856026.898445:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464307584 00000100:00100000:1.0:1787856026.898459:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464307584 00000100:00100000:1.0:1787856026.898606:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:1.0:1787856026.898629:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c263b399-c1aa-429f-9204-78dc9c713772+9:14436:x1874702464307584:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787856026.898670:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856026.898702:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366eaf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616fbc expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.898870:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366eaff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.898889:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366eaff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.898903:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366eaff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.898921:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eb06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.898930:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eb06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.898961:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eb06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856026.899134:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787856026.899255:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366eaff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.899263:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366eaff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.899271:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366eaff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.899277:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fec00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787856026.899282:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366eaff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.899289:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366eaff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.899304:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c8d1d300) 00010000:00010000:1.0:1787856026.899308:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856026.899314:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366eaff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.899321:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366eaff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.899337:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eb06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.899356:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eb06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.899362:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eb06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.899367:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff400 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787856026.899371:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eb06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.899378:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eb06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.899387:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a73c8d1d800) 00010000:00010000:1.0:1787856026.899389:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856026.899392:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eb06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.899399:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eb06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.899448:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366eaf8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fbc expref: 11 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.899460:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c8d1d300) 00010000:00010000:1.0:1787856026.899462:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787856026.899466:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fe200/0x516929ca3366eaf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fbc expref: 11 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856026.899487:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe200, rc 0) 00000100:00100000:1.0:1787856026.899569:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c263b399-c1aa-429f-9204-78dc9c713772+10:14436:x1874702464307584:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 943us (1395us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787856026.899579:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 25 00000100:00100000:2.0:1787856026.902846:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856026.903046:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464307712 00000100:00100000:3.0:1787856026.903060:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464307712 00000100:00100000:3.0:1787856026.903142:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 26 00000100:00100000:3.0:1787856026.903155:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c263b399-c1aa-429f-9204-78dc9c713772+10:14436:x1874702464307712:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:3.0:1787856026.903188:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856026.903222:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366eb14 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616fc3 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.903383:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366eb1b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.903404:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366eb1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.903420:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366eb1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856026.903488:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787856026.903493:0:14360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787856026.903521:0:14360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366eb1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.903557:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366eb14 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fc3 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.903579:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366eb1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fc3 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856026.903589:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a73cb5a9400) 00010000:00010000:3.0:1787856026.903593:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787856026.903597:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a72c337e000, rc 0) 00000100:00100000:3.0:1787856026.903689:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c263b399-c1aa-429f-9204-78dc9c713772+11:14436:x1874702464307712:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 536us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856026.903698:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 26 00000100:00100000:2.0:1787856026.907852:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856026.908000:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464307840 00000100:00100000:0.0:1787856026.908014:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464307840 00000100:00100000:0.0:1787856026.908083:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:0.0:1787856026.908095:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c263b399-c1aa-429f-9204-78dc9c713772+11:14436:x1874702464307840:12345-192.168.201.38@tcp:37:lfs.0 00000100:00100000:0.0:1787856026.917310:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c263b399-c1aa-429f-9204-78dc9c713772+11:14436:x1874702464307840:12345-192.168.201.38@tcp:37:lfs.0 Request processed in 9201us (9456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856026.917339:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:2.0:1787856026.921266:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856026.921381:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464308096 00000100:00100000:3.0:1787856026.921394:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464308096 00000100:00100000:3.0:1787856026.921524:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:3.0:1787856026.921536:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c60fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c263b399-c1aa-429f-9204-78dc9c713772+11:14436:x1874702464308096:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1787856026.922110:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c60fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c263b399-c1aa-429f-9204-78dc9c713772+12:14436:x1874702464308096:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 573us (855us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787856026.922119:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:2.0:1787856026.981302:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856026.981417:0:16043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464308224 00000100:00100000:0.0:1787856026.981430:0:16043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464308224 00000100:00100000:0.0:1787856026.981507:0:16043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:0.0:1787856026.981521:0:16043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+10:14442:x1874702464308224:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:0.0:1787856026.981551:0:16043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856026.981579:0:16043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366eb22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616fca expref: -99 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.981696:0:16043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366eb29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.981716:0:16043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366eb29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.981730:0:16043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366eb29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.981747:0:16043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366eb30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.981755:0:16043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366eb30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.981762:0:16043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366eb30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982245:0:16043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366eb37 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982257:0:16043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366eb37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982265:0:16043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366eb37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856026.982307:0:16043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787856026.982312:0:16043:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787856026.982365:0:16043:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366eb37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982381:0:16043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366eb29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982411:0:16043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366eb29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982418:0:16043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366eb29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982425:0:16043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787856026.982430:0:16043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366eb29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982439:0:16043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366eb29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982454:0:16043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c8d1d300) 00010000:00010000:2.0:1787856026.982457:0:16043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856026.982463:0:16043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366eb29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982470:0:16043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366eb29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982488:0:16043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366eb30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982494:0:16043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366eb30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982500:0:16043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366eb30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982505:0:16043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787856026.982515:0:16043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366eb30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982522:0:16043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366eb30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982530:0:16043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a73f49fb300) 00010000:00010000:2.0:1787856026.982533:0:16043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856026.982536:0:16043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366eb30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982541:0:16043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366eb30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982582:0:16043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366eb22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fca expref: 12 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982597:0:16043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229200/0x516929ca3366eb37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fca expref: 11 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.982605:0:16043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a73cb5a9400) 00010000:00010000:2.0:1787856026.982607:0:16043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787856026.982625:0:16043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229200, rc 0) 00000100:00100000:2.0:1787856026.982722:0:16043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+11:14442:x1874702464308224:12345-192.168.201.38@tcp:101:bash.0 Request processed in 1203us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856026.982731:0:16043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 27 00000100:00100000:1.0:1787856026.990117:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856026.990225:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464308480 00000100:00100000:2.0:1787856026.990247:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464308480 00000100:00100000:2.0:1787856026.990326:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:2.0:1787856026.990339:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+11:14442:x1874702464308480:12345-192.168.201.38@tcp:101:bash.0 00010000:00010000:2.0:1787856026.990384:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856026.990413:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366eb3e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616fd1 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.990588:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366eb45 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.990607:0:14361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366eb1b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fc3 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.990617:0:14361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366eb45 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.990674:0:14361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366eb1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fc3 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.990692:0:14361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366eb1b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fc3 expref: 11 pid: 14360 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856026.990709:0:14361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f7649680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14361:1874702486315776:192.168.201.38@tcp:104: 00000100:00100000:2.0:1787856026.990902:0:14361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73fa998240 going to sleep for 11 seconds 00000100:00100000:1.0:1787856026.993166:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856026.993513:0:14361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f7649680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14361:1874702486315776:192.168.201.38@tcp:104: 00010000:00010000:2.0:1787856026.993552:0:14361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366eb45 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856026.993565:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464308608 00000100:00100000:0.0:1787856026.993574:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464308608 00010000:00010000:0.0:1787856026.993643:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366eb1b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fc3 expref: 12 pid: 14360 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856026.993721:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:0.0:1787856026.993733:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c263b399-c1aa-429f-9204-78dc9c713772+12:2358:x1874702464308608:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856026.993753:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856026.993762:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366eb1b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fc3 expref: 12 pid: 14360 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.993917:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366eb1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fc3 expref: 12 pid: 14360 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.993948:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e000/0x516929ca3366eb1b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fc3 expref: 12 pid: 14360 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.993967:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a73cb5a9400) 00010000:00010000:0.0:1787856026.993973:0:14346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366eb45 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.993984:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366eb45 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.993992:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366eb45 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856026.994027:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856026.994100:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c263b399-c1aa-429f-9204-78dc9c713772+11:2358:x1874702464308608:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 368us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856026.994109:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00010000:00010000:2.0:1787856026.994670:0:14361:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366eb45 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.994681:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366eb45 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.997178:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366eb4c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.997217:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366eb4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856026.997234:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366eb4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.001110:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228000/0x516929ca3366eb53 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.001135:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228000/0x516929ca3366eb53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.001148:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228000/0x516929ca3366eb53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856027.001174:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787856027.001211:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366eb45 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.001219:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366eb45 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.001226:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366eb45 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.001232:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787856027.001237:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366eb45 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.001264:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366eb45 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.001278:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a73cb5a9400) 00010000:00010000:2.0:1787856027.001282:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856027.001287:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366eb45 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.001294:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366eb45 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787856027.001309:0:14361:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e2df30d reply state 00000000d934364b transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366eb4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856027.001317:0:14361:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787856027.001363:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366eb3e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd1 expref: 14 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.001378:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228000/0x516929ca3366eb53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd1 expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.001385:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:2.0:1787856027.001388:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787856027.001391:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228000, rc 0) 00000100:00100000:2.0:1787856027.001492:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+14:14442:x1874702464308480:12345-192.168.201.38@tcp:101:bash.0 Request processed in 11155us (11389us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787856027.001501:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00000040:00080000:3.0:1787856027.005029:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787856027.005331:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366eb4c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.005371:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366eb4c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.005380:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366eb4c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.005389:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787856027.005396:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366eb4c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.005405:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366eb4c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.005424:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a73c7093900) 00010000:00010000:2.0:1787856027.005427:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856027.005433:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366eb4c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.005439:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366eb4c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856027.017560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856027.018221:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464308736 00000100:00100000:0.0:1787856027.018257:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464308736 00000100:00100000:0.0:1787856027.018366:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:0.0:1787856027.018381:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7444b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+13:14442:x1874702464308736:12345-192.168.201.38@tcp:101:bash.0 00000100:00080000:2.0:1787856027.018407:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787856027.018416:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856027.018450:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366eb61 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616fd8 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.018543:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366eb68 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.018561:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366eb68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.018575:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366eb68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856027.018643:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787856027.018648:0:14360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787856027.018686:0:14360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366eb68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.018700:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366eb68 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.018730:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366eb61 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd8 expref: 15 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.018753:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366eb68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd8 expref: 14 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.018836:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:0.0:1787856027.018847:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856027.018852:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143400, rc 0) 00000100:00100000:0.0:1787856027.018946:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7444b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+14:14442:x1874702464308736:12345-192.168.201.38@tcp:101:bash.0 Request processed in 569us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856027.018955:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:1.0:1787856027.023462:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856027.023600:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464308992 00000100:00100000:0.0:1787856027.023615:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464308992 00000100:00100000:0.0:1787856027.023699:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:0.0:1787856027.023711:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1379e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+14:14442:x1874702464308992:12345-192.168.201.38@tcp:35:bash.0 00000100:00100000:0.0:1787856027.024269:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1379e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+15:14442:x1874702464308992:12345-192.168.201.38@tcp:35:bash.0 Request processed in 557us (819us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787856027.024279:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:3.0:1787856027.129294:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856027.129602:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464309248 00000100:00100000:1.0:1787856027.129616:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464309248 00000100:00100000:1.0:1787856027.129720:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:1.0:1787856027.129732:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7446d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+15:14453:x1874702464309248:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787856027.129765:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856027.129838:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eb6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616fdf expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856027.130003:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787856027.130157:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eb6f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fdf expref: 17 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.130175:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a73c8d1d300) 00010000:00010000:1.0:1787856027.130179:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787856027.130185:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eb6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fdf expref: 17 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.130203:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6ff400, rc 0) 00000100:00100000:1.0:1787856027.130299:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7446d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+16:14453:x1874702464309248:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 568us (1022us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787856027.130328:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 30 00000100:00100000:2.0:1787856027.137204:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856027.137517:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464309504 00000100:00100000:0.0:1787856027.137530:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464309504 00000100:00100000:0.0:1787856027.137591:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:0.0:1787856027.137603:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f7649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+16:14453:x1874702464309504:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:0.0:1787856027.137989:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f7649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+17:14453:x1874702464309504:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 385us (795us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787856027.137997:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:2.0:1787856027.193822:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856027.194063:0:16043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464309760 00000100:00100000:1.0:1787856027.194077:0:16043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464309760 00000100:00100000:1.0:1787856027.194164:0:16043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:1.0:1787856027.194177:0:16043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f764b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+17:14456:x1874702464309760:12345-192.168.201.38@tcp:101:lfs.0 00010000:00010000:1.0:1787856027.194210:0:16043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856027.194360:0:16043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eb7d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616fe6 expref: -99 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.194494:0:16043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366eb84 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.194512:0:16043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366eb84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.194529:0:16043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366eb84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787856027.194543:0:16043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787856027.195085:0:16043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6ff400/0x516929ca3366eb7d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fe6 expref: 20 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.195110:0:16043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366eb84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fe6 expref: 19 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.195121:0:16043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:1.0:1787856027.195124:0:16043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787856027.195129:0:16043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fec00, rc 0) 00000100:00100000:1.0:1787856027.195384:0:16043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f764b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+19:14456:x1874702464309760:12345-192.168.201.38@tcp:101:lfs.0 Request processed in 1063us (1470us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787856027.195393:0:16043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 31 00000100:00100000:3.0:1787856027.202843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856027.202898:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856027.203158:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464309888 00000100:00100000:1.0:1787856027.203171:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464309888 00000100:00100000:1.0:1787856027.203265:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1787856027.203278:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74443c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+19:2360:x1874702464309888:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856027.203298:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856027.203331:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366eb84 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fe6 expref: 19 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.203356:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:1.0:1787856027.203363:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856027.203445:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74443c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+18:2360:x1874702464309888:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 169us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856027.203454:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:0.0:1787856027.203600:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464310016 00000100:00100000:0.0:1787856027.203606:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464310016 00000100:00100000:0.0:1787856027.203667:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:0.0:1787856027.203675:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7445e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+18:14456:x1874702464310016:12345-192.168.201.38@tcp:54:lfs.0 00010000:00010000:0.0:1787856027.203752:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366eb92 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.203769:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366eb92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.203834:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366eb92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.203870:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366eb92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.203877:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366eb92 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.203883:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366eb92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.203890:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142e00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787856027.203895:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366eb92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.203903:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366eb92 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.203911:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:0.0:1787856027.203914:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787856027.203919:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366eb92 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.203925:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366eb92 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856027.203968:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7445e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+18:14456:x1874702464310016:12345-192.168.201.38@tcp:54:lfs.0 Request processed in 294us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856027.203975:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 32 00000100:00100000:2.0:1787856027.208075:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856027.208421:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464310272 00000100:00100000:3.0:1787856027.208436:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464310272 00000100:00100000:3.0:1787856027.208546:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:3.0:1787856027.208559:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+18:14456:x1874702464310272:12345-192.168.201.38@tcp:35:lfs.0 00000100:00100000:3.0:1787856027.208978:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+19:14456:x1874702464310272:12345-192.168.201.38@tcp:35:lfs.0 Request processed in 419us (916us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787856027.208988:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:3.0:1787856027.475750:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856027.476016:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464310528 00000100:00100000:0.0:1787856027.476030:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464310528 00000100:00100000:0.0:1787856027.476111:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:0.0:1787856027.476124:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7445a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+19:14487:x1874702464310528:12345-192.168.201.38@tcp:101:cat.0 00010000:00010000:0.0:1787856027.476159:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856027.476187:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366eb99 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616fed expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.476330:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366eba0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.476349:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366eba0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.476363:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366eba0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856027.476377:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787856027.476563:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366eb99 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fed expref: 22 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.476586:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366eba0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fed expref: 21 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.476597:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:0.0:1787856027.476601:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856027.476605:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142400, rc 0) 00000100:00100000:0.0:1787856027.476699:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7445a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+21:14487:x1874702464310528:12345-192.168.201.38@tcp:101:cat.0 Request processed in 577us (965us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787856027.476729:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 33 00000100:00100000:2.0:1787856027.479685:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856027.479816:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464310656 00000100:00100000:0.0:1787856027.479828:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464310656 00000100:00100000:0.0:1787856027.479905:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:0.0:1787856027.479914:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+21:2360:x1874702464310656:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856027.479930:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856027.479959:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366eba0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fed expref: 21 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.479981:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:0.0:1787856027.479986:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856027.480177:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+20:2360:x1874702464310656:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 263us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856027.480186:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:3.0:1787856027.481586:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856027.481654:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464310912 00000100:00100000:0.0:1787856027.481665:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464310912 00000100:00100000:0.0:1787856027.481730:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 8 00000100:00100000:0.0:1787856027.481738:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e7445680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+20:14487:x1874702464310912:12345-192.168.201.38@tcp:35:cat.0 00000100:00100000:0.0:1787856027.482454:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e7445680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+21:14487:x1874702464310912:12345-192.168.201.38@tcp:35:cat.0 Request processed in 710us (869us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787856027.482463:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 8 00010000:00010000:0.0:1787856027.516183:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856027.543294:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856027.543429:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464311168 00000100:00100000:0.0:1787856027.543443:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464311168 00000100:00100000:0.0:1787856027.543522:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:0.0:1787856027.543534:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+21:14493:x1874702464311168:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:0.0:1787856027.543580:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856027.543718:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ebae lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616ff4 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.544058:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ebb5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.544078:0:14362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228000/0x516929ca3366eb53 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd1 expref: 22 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.544086:0:14362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366eb68 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd8 expref: 22 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.544096:0:14362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ebb5 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.544145:0:14362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366eb68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd8 expref: 22 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.544163:0:14362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366eb68 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd8 expref: 22 pid: 14360 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856027.544183:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1321a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14362:1874702486315904:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787856027.544338:0:14362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228000/0x516929ca3366eb53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd1 expref: 22 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.544348:0:14362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228000/0x516929ca3366eb53 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd1 expref: 22 pid: 14361 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856027.544370:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1321680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14362:1874702486316032:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787856027.544402:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c44bd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787856027.549358:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856027.549491:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1321a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14362:1874702486315904:192.168.201.38@tcp:104: 00000100:00100000:0.0:1787856027.549508:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1321680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14362:1874702486316032:192.168.201.38@tcp:104: 00010000:00010000:0.0:1787856027.549544:0:14362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ebb5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856027.549638:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856027.551381:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464311424 00000100:00100000:3.0:1787856027.551399:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464311424 00010000:00010000:3.0:1787856027.551470:0:14347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228000/0x516929ca3366eb53 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd1 expref: 23 pid: 14361 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856027.551555:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464311296 00000100:00100000:3.0:1787856027.551559:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464311296 00010000:00010000:3.0:1787856027.551596:0:14347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366eb68 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd8 expref: 24 pid: 14360 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856027.551642:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:1.0:1787856027.551664:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c2ee9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+24:2358:x1874702464311424:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856027.551683:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856027.551692:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228000/0x516929ca3366eb53 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd1 expref: 24 pid: 14361 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.551705:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228000/0x516929ca3366eb53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd1 expref: 24 pid: 14361 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.551733:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228000/0x516929ca3366eb53 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd1 expref: 24 pid: 14361 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.551820:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:1.0:1787856027.551828:0:14345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ebb5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.551839:0:14345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ebb5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.551847:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856027.551928:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c2ee9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+23:2358:x1874702464311424:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 267us (2587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856027.551936:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:1.0:1787856027.551995:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:1.0:1787856027.552002:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+22:2358:x1874702464311296:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856027.552010:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856027.552015:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366eb68 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd8 expref: 22 pid: 14360 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.552026:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366eb68 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd8 expref: 22 pid: 14360 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.552038:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366eb68 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c930616fd8 expref: 22 pid: 14360 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.552050:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:1.0:1787856027.552053:0:14345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ebb5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.552073:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ebb5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.552083:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ebb5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.552114:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856027.552139:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+21:2358:x1874702464311296:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 138us (2503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856027.552146:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00010000:00010000:2.0:1787856027.552397:0:14362:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ebb5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.552414:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ebb5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856027.552438:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787856027.552678:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ebae lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ff4 expref: 22 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.552698:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142e00/0x516929ca3366ebb5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ff4 expref: 21 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.552706:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:2.0:1787856027.552710:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787856027.552712:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142e00, rc 0) 00000100:00100000:2.0:1787856027.552752:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+21:14493:x1874702464311168:12345-192.168.201.38@tcp:101:dd.0 Request processed in 9220us (9472us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787856027.552761:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 34 00000100:00100000:2.0:1787856027.556467:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856027.556570:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464311680 00000100:00100000:0.0:1787856027.556583:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464311680 00000100:00100000:0.0:1787856027.557047:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 35 00000100:00100000:0.0:1787856027.557062:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+21:14493:x1874702464311680:12345-192.168.201.38@tcp:36:dd.0 00010000:00010000:0.0:1787856027.557423:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366ebc3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.557446:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366ebc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856027.557461:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366ebc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787856027.557524:0:14360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787856027.557567:0:14360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007db4ead4 reply state 00000000df3d6a9e transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366ebc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856027.557578:0:14360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787856027.558006:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+24:14493:x1874702464311680:12345-192.168.201.38@tcp:36:dd.0 Request processed in 945us (1550us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787856027.558028:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 35 00000020:00080000:0.0:1787856027.558034:0:14360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787856027.561222:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00010000:00010000:1.0:1787856027.561713:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366ebc3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.561730:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366ebc3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.561738:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366ebc3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.561758:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5143200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:1.0:1787856027.561764:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366ebc3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.561814:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366ebc3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.561837:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:1.0:1787856027.561840:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787856027.561846:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366ebc3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.561875:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143200/0x516929ca3366ebc3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856027.564197:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464311808 00000100:00100000:3.0:1787856027.564224:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464311808 00000100:00100000:3.0:1787856027.564478:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:3.0:1787856027.564493:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+23:14493:x1874702464311808:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:3.0:1787856027.564528:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856027.564555:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ebca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930616ffb expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856027.564655:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ebca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ffb expref: 24 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856027.564675:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ebca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ffb expref: 24 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856027.564699:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:3.0:1787856027.564703:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787856027.564707:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a72c337fc00, rc 0) 00000100:00100000:3.0:1787856027.564905:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+24:14493:x1874702464311808:12345-192.168.201.38@tcp:101:dd.0 Request processed in 415us (3700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856027.564913:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 36 00000100:00100000:2.0:1787856027.587204:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856027.587337:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464312064 00000100:00100000:3.0:1787856027.587351:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464312064 00000100:00100000:3.0:1787856027.587441:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:3.0:1787856027.587453:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+24:14493:x1874702464312064:12345-192.168.201.38@tcp:103:dd.0 00010000:00010000:3.0:1787856027.587473:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856027.587529:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ebca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930616ffb expref: 24 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856027.587555:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:3.0:1787856027.587563:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787856027.590252:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+23:14493:x1874702464312064:12345-192.168.201.38@tcp:103:dd.0 Request processed in 486us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856027.590272:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:0.0:1787856027.590547:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856027.590859:0:16043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464312192 00000100:00100000:1.0:1787856027.590871:0:16043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464312192 00000100:00100000:1.0:1787856027.591082:0:16043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:1.0:1787856027.591096:0:16043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1321680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+23:14493:x1874702464312192:12345-192.168.201.38@tcp:58:dd.0 00010000:00010000:1.0:1787856027.591225:0:16043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ebd1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.591249:0:16043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ebd1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856027.591263:0:16043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ebd1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787856027.592406:0:16043:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787856027.592579:0:16043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787856027.592694:0:16043:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787856027.597512:0:16043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1321680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+23:14493:x1874702464312192:12345-192.168.201.38@tcp:58:dd.0 Request processed in 6400us (6947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856027.599342:0:16043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 37 00000100:00100000:0.0:1787856027.605962:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856027.606229:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464312320 00000100:00100000:2.0:1787856027.606244:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464312320 00000100:00100000:2.0:1787856027.606332:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 38 00000100:00100000:2.0:1787856027.606346:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1321a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+23:14493:x1874702464312320:12345-192.168.201.38@tcp:101:dd.0 00010000:00010000:2.0:1787856027.606375:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856027.606405:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229800/0x516929ca3366ebd8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930617002 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.606515:0:14362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ebd1 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.606531:0:14362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229800/0x516929ca3366ebd8 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617002 expref: 24 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.606554:0:14362:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ebd1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.606570:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229800/0x516929ca3366ebd8 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617002 expref: 24 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.606588:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:2.0:1787856027.606592:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787856027.606596:0:14362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229800/0x516929ca3366ebd8 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617002 expref: 24 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856027.606605:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1229800, rc 0) 00000100:00100000:2.0:1787856027.606706:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1321a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+24:14493:x1874702464312320:12345-192.168.201.38@tcp:101:dd.0 Request processed in 363us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856027.606715:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 38 00000001:00080000:3.0:1787856027.895530:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:3.0:1787856027.895566:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:3.0:1787856027.895580:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1787856027.895599:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:3.0:1787856028.029031:0:14393:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787856028.029046:0:14393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787856028.029126:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787856028.029134:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787856028.029299:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73e74443c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14393:1874702486316160:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787856028.029450:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73c92f5840 going to sleep for 11 seconds 00000100:00100000:3.0:1787856028.032840:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73e74443c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14393:1874702486316160:192.168.201.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787856028.040855:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856028.041141:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464312448 00000100:00100000:1.0:1787856028.041154:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464312448 00000100:00100000:1.0:1787856028.041224:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:1.0:1787856028.041236:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1320f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+11:14494:x1874702464312448:12345-192.168.201.38@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787856028.041357:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1320f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+11:14494:x1874702464312448:12345-192.168.201.38@tcp:900:lhsmtool_posix.0 Request processed in 122us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856028.041387:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:0.0:1787856028.043177:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856028.043267:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464312576 00000100:00100000:3.0:1787856028.043277:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464312576 00000100:00100000:3.0:1787856028.043344:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:3.0:1787856028.043357:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1321e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+11:14494:x1874702464312576:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787856028.043399:0:14360:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787856028.043535:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1321e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+11:14494:x1874702464312576:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 180us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856028.043542:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 39 00000100:00100000:3.0:1787856028.046589:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856028.046829:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464312704 00000100:00100000:2.0:1787856028.046842:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464312704 00000100:00100000:2.0:1787856028.046921:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:2.0:1787856028.046935:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73e74443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+11:14494:x1874702464312704:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787856028.047036:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ebdf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047078:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ebdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047210:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ebdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047437:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366ebe6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047464:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366ebe6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047478:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366ebe6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047510:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ebed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047519:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ebed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047526:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ebed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787856028.047572:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787856028.047576:0:14362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787856028.047767:0:14362:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ebed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047826:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ebdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047850:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ebdf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047858:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ebdf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047864:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787856028.047869:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ebdf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047877:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ebdf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047890:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a73c8d1d700) 00010000:00010000:2.0:1787856028.047894:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856028.047900:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ebdf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047907:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ebdf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047924:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366ebe6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047930:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366ebe6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047936:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366ebe6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047941:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228200 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787856028.047961:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366ebe6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047969:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366ebe6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047979:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9a73c7093900) 00010000:00010000:2.0:1787856028.047982:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856028.047986:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366ebe6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.047992:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228200/0x516929ca3366ebe6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.048010:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ebed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.048017:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ebed lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.048023:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ebed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.048029:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228a00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787856028.048032:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ebed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.048037:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ebed lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.048044:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:2.0:1787856028.048046:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787856028.048056:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ebed lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.048061:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ebed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856028.048160:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73e74443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+11:14494:x1874702464312704:12345-192.168.201.38@tcp:34:lhsmtool_posix.0 Request processed in 1224us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856028.048170:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 40 00000100:00100000:2.0:1787856028.056514:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856028.056598:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464312960 00000100:00100000:3.0:1787856028.056616:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464312960 00000100:00100000:3.0:1787856028.056880:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:3.0:1787856028.056896:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+11:14494:x1874702464312960:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787856028.056925:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856028.056955:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ebf4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930617009 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.057088:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ebfb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.057306:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ebfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.057322:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ebfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787856028.057338:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787856028.057526:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ebfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.057535:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ebfb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.057543:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ebfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.057549:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337f800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787856028.057554:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ebfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.057584:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ebfb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.057600:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:3.0:1787856028.057603:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787856028.057609:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ebfb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.057616:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ebfb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.058087:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ebf4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617009 expref: 13 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.058205:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a73c8d1d700) 00010000:00010000:3.0:1787856028.058207:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787856028.058212:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ebf4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617009 expref: 13 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.058223:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a72c337fc00, rc 0) 00000100:00100000:3.0:1787856028.058438:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+12:14494:x1874702464312960:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1545us (1931us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1787856028.058448:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 41 00000100:00100000:0.0:1787856028.065455:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856028.065543:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464313088 00000100:00100000:3.0:1787856028.065555:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464313088 00000100:00100000:3.0:1787856028.065630:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:3.0:1787856028.065653:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1320780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+12:14494:x1874702464313088:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787856028.065719:0:14361:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787856028.065906:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1320780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+12:14494:x1874702464313088:12345-192.168.201.38@tcp:53:lhsmtool_posix.0 Request processed in 265us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856028.065915:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 42 00000100:00100000:2.0:1787856028.069884:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856028.070435:0:16043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464313344 00000100:00100000:0.0:1787856028.070450:0:16043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464313344 00000100:00100000:0.0:1787856028.070536:0:16043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:0.0:1787856028.070548:0:16043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+12:14494:x1874702464313344:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787856028.070576:0:16043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856028.070605:0:16043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142000/0x516929ca3366ec09 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930617010 expref: -99 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787856028.082543:0:16043:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:0.0:1787856028.082565:0:16043:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1787856028.082749:0:16043:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1787856028.084276:0:16043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ec10 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.084427:0:16043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ec10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.084442:0:16043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ec10 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.084530:0:16043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142000/0x516929ca3366ec09 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617010 expref: 15 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.084568:0:16043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ec10 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617010 expref: 14 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.084577:0:16043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a73f49fbe00) 00010000:00010000:0.0:1787856028.084581:0:16043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787856028.084584:0:16043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143a00, rc 0) 00000100:00100000:0.0:1787856028.084988:0:16043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+14:14494:x1874702464313344:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 14439us (15114us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787856028.085000:0:16043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 43 00000100:00100000:0.0:1787856028.102004:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856028.102133:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464313600 00000100:00100000:3.0:1787856028.102146:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464313600 00000100:00100000:3.0:1787856028.102229:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:3.0:1787856028.102241:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1322d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+14:14494:x1874702464313600:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787856028.102337:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856028.102374:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143a00/0x516929ca3366ec10 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617010 expref: 14 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.102402:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a73f49fbe00) 00010000:00010000:3.0:1787856028.102416:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787856028.102450:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ec1e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.102467:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ec1e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.102479:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ec1e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103001:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec25 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf74a9b56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103028:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf74a9b56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103061:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf74a9b56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103513:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ec1e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103522:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ec1e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103529:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ec1e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103535:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337fc00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787856028.103539:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ec1e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103548:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ec1e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103564:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a73cb5a9400) 00010000:00010000:3.0:1787856028.103567:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856028.103572:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ec1e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103578:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337fc00/0x516929ca3366ec1e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103591:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec25 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf74a9b56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103610:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec25 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf74a9b56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103622:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf74a9b56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103628:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337f800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787856028.103631:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec25 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf74a9b56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103658:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec25 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf74a9b56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103669:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf74a9b56 (ffff9a73cb5a9b00) 00010000:00010000:3.0:1787856028.103671:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856028.103674:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec25 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf74a9b56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.103681:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec25 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf74a9b56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856028.104068:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1322d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+13:14494:x1874702464313600:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 1822us (2072us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787856028.104079:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 44 00000100:00100000:2.0:1787856028.107214:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856028.107340:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464313728 00000100:00100000:3.0:1787856028.107353:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464313728 00000100:00100000:3.0:1787856028.107421:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:3.0:1787856028.107433:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+13:14494:x1874702464313728:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787856028.107458:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787856028.107488:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec2c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930617017 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.107559:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337ea00/0x516929ca3366ec33 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.107575:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337ea00/0x516929ca3366ec33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.107587:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337ea00/0x516929ca3366ec33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.107726:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec2c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617017 expref: 15 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.107759:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337ea00/0x516929ca3366ec33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617017 expref: 14 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.107769:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a73cb5a9800) 00010000:00010000:3.0:1787856028.107772:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787856028.108250:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a72c337ea00, rc 0) 00000100:00100000:3.0:1787856028.108528:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+14:14494:x1874702464313728:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 1095us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856028.108538:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 45 00000100:00100000:2.0:1787856028.111506:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856028.111618:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464313984 00000100:00100000:0.0:1787856028.111630:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464313984 00000100:00100000:2.0:1787856028.112090:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 46 00000100:00100000:2.0:1787856028.112209:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+14:14494:x1874702464313984:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787856028.112344:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ec3a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.112367:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ec3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.112381:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ec3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787856028.113012:0:14362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1787856028.113024:0:14362:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 518965248094ns, next at 519965245534ns, rc = 0 00000004:00010000:2.0:1787856028.113142:0:14362:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000acdef23a reply state 0000000012216c97 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ec3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856028.113154:0:14362:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787856028.113305:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+16:14494:x1874702464313984:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 1098us (1808us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787856028.114529:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 46 00010000:00010000:2.0:1787856028.117066:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ec3a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.117089:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ec3a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.117109:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ec3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.117117:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:2.0:1787856028.117123:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ec3a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.117131:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ec3a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.117154:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a73cb5a9800) 00010000:00010000:2.0:1787856028.117158:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787856028.117164:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ec3a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.117170:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228800/0x516929ca3366ec3a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856028.118103:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856028.118178:0:16043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464314112 00000100:00100000:0.0:1787856028.118191:0:16043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464314112 00000100:00100000:0.0:1787856028.118264:0:16043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:0.0:1787856028.118277:0:16043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+15:14494:x1874702464314112:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787856028.118318:0:16043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856028.118343:0:16043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ec41 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c93061701e expref: -99 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.118420:0:16043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ec41 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c93061701e expref: 16 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.118439:0:16043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ec41 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c93061701e expref: 16 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.118489:0:16043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a73cb5a9800) 00010000:00010000:0.0:1787856028.118493:0:16043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787856028.118497:0:16043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5143000, rc 0) 00000100:00100000:0.0:1787856028.118577:0:16043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+16:14494:x1874702464314112:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 302us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856028.118584:0:16043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 47 00000100:00100000:0.0:1787856028.124898:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856028.125254:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464314240 00000100:00100000:1.0:1787856028.125267:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464314240 00000100:00100000:1.0:1787856028.125352:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00100000:1.0:1787856028.125364:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2360:x1874702464314240:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787856028.125844:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13230c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:2360:x1874702464314240:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 480us (958us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787856028.125853:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 12 00000100:00080000:2.0:1787856028.126067:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787856028.128580:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856028.133459:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464314496 00000100:00100000:1.0:1787856028.133481:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464314496 00000100:00100000:1.0:1787856028.133580:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:1.0:1787856028.133591:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+16:14494:x1874702464314496:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787856028.133970:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+17:14494:x1874702464314496:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 379us (5406us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787856028.133978:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 9 00000100:00100000:1.0:1787856028.136625:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856028.140012:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464314752 00000100:00100000:3.0:1787856028.140031:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464314752 00000100:00100000:2.0:1787856028.140334:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:2.0:1787856028.140519:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+17:14494:x1874702464314752:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787856028.140742:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+17:14494:x1874702464314752:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 395us (4129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856028.140751:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 48 00000100:00100000:2.0:1787856028.143377:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856028.143926:0:16043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464314880 00000100:00100000:0.0:1787856028.143941:0:16043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464314880 00000100:00100000:0.0:1787856028.144056:0:16043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:0.0:1787856028.144068:0:16043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+17:14494:x1874702464314880:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787856028.144103:0:16043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787856028.144131:0:16043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366ec48 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930617025 expref: -99 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.144218:0:16043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ec4f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.144234:0:16043:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ec4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.144248:0:16043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ec4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787856028.144301:0:16043:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787856028.144324:0:16043:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ec4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.144387:0:16043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143400/0x516929ca3366ec48 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617025 expref: 19 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.144409:0:16043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ec4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617025 expref: 18 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.144418:0:16043:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a73cb5a9800) 00010000:00010000:0.0:1787856028.144420:0:16043:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787856028.144424:0:16043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73c5142400, rc 0) 00000100:00100000:0.0:1787856028.144499:0:16043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+18:14494:x1874702464314880:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 433us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856028.144506:0:16043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 49 00000100:00100000:0.0:1787856028.148027:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856028.153156:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464315008 00000100:00100000:2.0:1787856028.153176:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464315008 00000100:00100000:2.0:1787856028.153315:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:2.0:1787856028.153329:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1320b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:2358:x1874702464315008:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787856028.153364:0:15045:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787856028.153399:0:15045:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059a9e003/0x516929ca3366ec56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c93061702c expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787856028.153434:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90849c, blocks: 0x1 00010000:00010000:2.0:1787856028.153462:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=519s v=(0 0) 00010000:00010000:2.0:1787856028.153468:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856028.153479:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059a9e003/0x516929ca3366ec56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c93061702c expref: 7 pid: 15045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.153505:0:15045:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000059a9e003/0x516929ca3366ec56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c93061702c expref: 7 pid: 15045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.153521:0:15045:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73d1228a00, rc 0) 00000100:00100000:2.0:1787856028.153831:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1320b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:2358:x1874702464315008:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 503us (5821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856028.153841:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:1.0:1787856028.160929:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856028.161426:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464315264 00000100:00100000:0.0:1787856028.161440:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464315264 00000100:00100000:0.0:1787856028.161560:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:0.0:1787856028.161573:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+18:14494:x1874702464315264:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787856028.165071:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+18:14494:x1874702464315264:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 3482us (4139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856028.165945:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 50 00000100:00100000:2.0:1787856028.169197:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856028.169300:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464315392 00000100:00100000:3.0:1787856028.169314:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464315392 00000100:00100000:3.0:1787856028.169391:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:3.0:1787856028.169403:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+18:14494:x1874702464315392:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787856028.257714:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:1.0:1787856028.257747:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1787856028.257760:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787856028.258084:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787856028.258113:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73f9df9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486316288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787856028.258206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856028.258292:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486316288 00000100:00100000:3.0:1787856028.258301:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486316288 00000100:00100000:3.0:1787856028.258372:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787856028.258382:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874702486316288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787856028.258585:0:15044:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787856028.258589:0:15044:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787856028.258591:0:15044:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787856028.258593:0:15044:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787856028 -> 1787856028 00002000:00010000:3.0:1787856028.258596:0:15044:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787856028.258654:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874702486316288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 273us (448us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787856028.258663:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1787856028.258689:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787856028.258728:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a73f9df9a40/2, rc 0, transno 8589934595 00000100:00100000:3.0:1787856028.258902:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73f9df9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874702486316288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787856028.260277:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+14:14494:x1874702464315392:12345-192.168.201.38@tcp:44:lhsmtool_posix.0 Request processed in 90863us (91082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856028.260294:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 51 00000100:00100000:3.0:1787856028.262708:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856028.262992:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464315520 00000100:00100000:2.0:1787856028.263004:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464315520 00000100:00100000:2.0:1787856028.263077:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:2.0:1787856028.263088:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400695a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:2360:x1874702464315520:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787856028.263243:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400695a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:2360:x1874702464315520:12345-192.168.201.38@tcp:16:lhsmtool_posix.0 Request processed in 156us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856028.263251:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:1.0:1787856028.273709:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856028.275258:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464315776 00000100:00100000:2.0:1787856028.275279:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464315776 00000100:00100000:3.0:1787856028.277428:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:3.0:1787856028.277447:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+14:14494:x1874702464315776:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787856028.277530:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856028.277571:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142400/0x516929ca3366ec4f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617025 expref: 14 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.277745:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a73cb5a9800) 00010000:00010000:3.0:1787856028.277769:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787856028.278329:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec5d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.278350:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.278363:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787856028.278652:0:14361:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085923d7a reply state 000000003dc4b519 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856028.278664:0:14361:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787856028.278981:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+15:14494:x1874702464315776:12345-192.168.201.38@tcp:36:lhsmtool_posix.0 Request processed in 1533us (5284us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787856028.278992:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 52 00000100:00100000:1.0:1787856028.286720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856028.286808:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464315904 00000100:00100000:1.0:1787856028.286821:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464315904 00000100:00100000:1.0:1787856028.286896:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:1.0:1787856028.286909:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1379680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:14494:x1874702464315904:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787856028.286951:0:15046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787856028.286980:0:15046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ec64 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbbc00c930617033 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.287022:0:15046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059a9e003/0x516929ca3366ec56 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c93061702c expref: 8 pid: 15045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.287034:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856028.287039:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856028.287046:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ec64 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617033 expref: 8 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.287136:0:15046:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059a9e003/0x516929ca3366ec56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c93061702c expref: 8 pid: 15045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.287153:0:15046:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059a9e003/0x516929ca3366ec56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c93061702c expref: 8 pid: 15045 timeout: 619 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856028.287171:0:15046:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1378b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15046:1874702486316416:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787856028.287284:0:15046:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c3307d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787856028.289172:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d13203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff37be87-90a7-463b-b734-d2f25b77f044:3304:1874702486316544:0@lo:400:kworker.0 00000100:00100000:0.0:1787856028.289260:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856028.289325:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d13212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486317056:0@lo:400:kworker.0 00000100:00100000:0.0:1787856028.289357:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856028.289388:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787856028.289393:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1322580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486316672:0@lo:400:kworker.0 00000100:00100000:0.0:1787856028.289421:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856028.289459:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486316544 00000100:00100000:0.0:1787856028.289467:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486316544 00000100:00100000:0.0:1787856028.289523:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787856028.289532:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+19:3304:x1874702486316544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856028.289584:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff37be87-90a7-463b-b734-d2f25b77f044+19:3304:x1874702486316544:12345-0@lo:400:kworker.0 Request processed in 53us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856028.289593:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787856028.289662:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d13203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ff37be87-90a7-463b-b734-d2f25b77f044:3304:1874702486316544:0@lo:400:kworker.0 00000100:00100000:0.0:1787856028.289688:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d13221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486316928:0@lo:400:kworker.0 00000100:00100000:0.0:1787856028.289713:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856028.290034:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1378f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486317184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787856028.290070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856028.290114:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486317184 00000100:00100000:1.0:1787856028.290119:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486317184 00000100:00100000:1.0:1787856028.290167:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787856028.290175:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486317184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787856028.290224:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787856028.290267:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874702486317184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856028.290274:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787856028.290299:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787856028.290331:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1378f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874702486317184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787856028.291689:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787856028.291714:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486316800:0@lo:400:kworker.0 00000100:00100000:0.0:1787856028.291896:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856028.291932:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d137a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486317312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856028.292277:0:16043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486317056 00000100:00100000:1.0:1787856028.292285:0:16043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486317056 00000100:00080000:1.0:1787856028.292316:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856028.292360:0:16043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486316928 00000100:00100000:1.0:1787856028.292364:0:16043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486316928 00000100:00080000:1.0:1787856028.292376:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787856028.292389:0:16043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486316800 00000100:00100000:1.0:1787856028.292391:0:16043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486316800 00000100:00100000:1.0:1787856028.292407:0:16043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787856028.292416:0:16043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1323c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486317056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787856028.292489:0:16043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1323c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874702486317056:12345-0@lo:400:kworker.0 Request processed in 73us (3130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856028.292497:0:16043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787856028.292544:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d13212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874702486317056:0@lo:400:kworker.0 00000100:00100000:1.0:1787856028.292573:0:16043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787856028.292579:0:16043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486316928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856028.296082:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787856028.296207:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787856028.296229:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df848b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486316800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787856028.296301:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df848b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874702486316800:12345-0@lo:400:kworker.0 Request processed in 83us (4404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856028.296309:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787856028.296399:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874702486316800:0@lo:400:kworker.0 00000100:00100000:1.0:1787856028.296705:0:15048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486317312 00000100:00100000:1.0:1787856028.296715:0:15048:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486317312 00000100:00100000:1.0:1787856028.296986:0:15048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787856028.296997:0:15048:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874702486317312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787856028.297045:0:15048:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787856028.297103:0:15048:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874702486317312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856028.297110:0:15048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787856028.297155:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d137a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874702486317312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787856028.297294:0:16043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874702486316928:12345-0@lo:400:kworker.0 Request processed in 4714us (7578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856028.297301:0:16043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787856028.297329:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d13221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874702486316928:0@lo:400:kworker.0 00010000:00010000:3.0:1787856028.303304:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec5d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.303332:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec5d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.303341:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.303349:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337e600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787856028.303356:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec5d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.303365:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec5d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.303419:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a73cb5a9800) 00010000:00010000:3.0:1787856028.303422:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787856028.303429:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec5d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.303437:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec5d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856028.304684:0:15044:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787856028.304699:0:15044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787856028.305052:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486316672 00000100:00100000:3.0:1787856028.305068:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486316672 00000100:00100000:3.0:1787856028.305125:0:15044:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787856028.305141:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787856028.305154:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73df84ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486316672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787856028.305294:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73df84ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874702486316672:12345-0@lo:400:kworker.0 Request processed in 143us (15871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856028.305303:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787856028.309103:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856028.309244:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1322580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874702486316672:0@lo:400:kworker.0 00000100:00100000:3.0:1787856028.309375:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464316032 00000100:00100000:3.0:1787856028.309383:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464316032 00010000:00010000:3.0:1787856028.309436:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059a9e003/0x516929ca3366ec56 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c93061702c expref: 9 pid: 15045 timeout: 619 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856028.309481:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:3.0:1787856028.309491:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+9:2358:x1874702464316032:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787856028.309510:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787856028.309537:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000059a9e003/0x516929ca3366ec56 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c93061702c expref: 9 pid: 15045 timeout: 619 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.309576:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059a9e003/0x516929ca3366ec56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c93061702c expref: 9 pid: 15045 timeout: 619 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.309622:0:14345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856028.309627:0:14345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856028.309644:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ec64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617033 expref: 9 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.309657:0:14345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ec64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617033 expref: 9 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.309706:0:14345:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ec64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617033 expref: 9 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856028.309724:0:14345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400694f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14345:1874702486317440:192.168.201.38@tcp:105: 00000100:00100000:3.0:1787856028.311952:0:14345:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73faa62540 going to sleep for 11 seconds 00010000:00010000:2.0:1787856028.315379:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059a9e003/0x516929ca3366ec56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c93061702c expref: 9 pid: 15045 timeout: 619 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856028.315409:0:15046:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1378b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15046:1874702486316416:192.168.201.38@tcp:104: 00010000:00010000:2.0:1787856028.315449:0:15046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ec64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617033 expref: 8 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.315467:0:15046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a73fa6fe600, rc 0) 00000100:00100000:2.0:1787856028.315568:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1379680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+8:14494:x1874702464315904:12345-192.168.201.38@tcp:101:lhsmtool_posix.0 Request processed in 28661us (28863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856028.315579:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 16 00000100:00100000:1.0:1787856028.317346:0:14345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400694f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14345:1874702486317440:192.168.201.38@tcp:105: 00010000:00010000:1.0:1787856028.317378:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856028.317428:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:2358:x1874702464316032:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 7936us (8492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856028.317441:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 13 00000100:00100000:1.0:1787856028.320261:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856028.320346:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464316160 00000100:00100000:3.0:1787856028.320359:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464316160 00000100:00100000:3.0:1787856028.320434:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:3.0:1787856028.320447:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1378f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:2357:x1874702464316160:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787856028.321215:0:15044:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787856028.321221:0:15044:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787856028 00002000:00010000:3.0:1787856028.321225:0:15044:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787856027 00002000:00010000:3.0:1787856028.321227:0:15044:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787856028 -> 1787856028 00002000:00010000:3.0:1787856028.321245:0:15044:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787856028.321326:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1378f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+8:2357:x1874702464316160:12345-192.168.201.38@tcp:2:lhsmtool_posix.0 Request processed in 880us (1077us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787856028.321338:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 17 00000100:00100000:3.0:1787856028.323425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856028.323517:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464316288 00000100:00100000:0.0:1787856028.323528:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464316288 00000100:00100000:0.0:1787856028.323725:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:0.0:1787856028.323751:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+8:2358:x1874702464316288:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787856028.323845:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366ec6b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.323871:0:15045:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ec64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617033 expref: 8 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.323882:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787856028.323886:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787856028.323892:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366ec6b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.324089:0:15045:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ec64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930617033 expref: 8 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.324108:0:15045:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ec64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930617033 expref: 8 pid: 15046 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856028.324128:0:15045:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a73d1320000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15045:1874702486317568:192.168.201.38@tcp:104: 00000100:00100000:1.0:1787856028.334138:0:15045:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73d8455e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787856028.336327:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856028.336542:0:15045:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a73d1320000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15045:1874702486317568:192.168.201.38@tcp:104: 00010000:00010000:2.0:1787856028.336589:0:15045:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366ec6b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856028.344135:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464316416 00000100:00100000:3.0:1787856028.344158:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464316416 00010000:00010000:0.0:1787856028.344376:0:14347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ec64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930617033 expref: 9 pid: 15046 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856028.344492:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 14 00000100:00100000:0.0:1787856028.344506:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+9:2358:x1874702464316416:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787856028.344527:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787856028.344558:0:14347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ec64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930617033 expref: 9 pid: 15046 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.344575:0:14347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ec64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930617033 expref: 9 pid: 15046 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.344618:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ec64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.38@tcp remote: 0xbbc00c930617033 expref: 9 pid: 15046 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.344647:0:14347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787856028.344653:0:14347:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787856028.344660:0:14347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366ec6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.344673:0:14347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366ec6b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.346938:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787856028.347043:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13203c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+8:2358:x1874702464316416:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 2529us (10720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856028.347059:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 14 00010000:00010000:3.0:1787856028.349389:0:15045:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366ec6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.349414:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366ec6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.351389:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366ec6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.351413:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366ec6b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.351422:0:15045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366ec6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.351429:0:15045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142200 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:3.0:1787856028.351435:0:15045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366ec6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.351444:0:15045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366ec6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.351481:0:15045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366ec6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.351489:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081da5707/0x516929ca3366ec6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856028.351695:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400697480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:2358:x1874702464316288:12345-192.168.201.38@tcp:1:lhsmtool_posix.0 Request processed in 27940us (28275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856028.351709:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 18 00000100:00100000:0.0:1787856028.356333:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856028.356700:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464316672 00000100:00100000:3.0:1787856028.356713:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464316672 00000100:00100000:3.0:1787856028.356816:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 53 00000100:00100000:3.0:1787856028.356829:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+14:14494:x1874702464316672:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787856028.356940:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec72 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.356963:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.356978:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.357286:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec79 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.357299:0:14360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ec41 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c93061701e expref: 15 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.357320:0:14360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec79 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.357363:0:14360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ec41 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.38@tcp remote: 0xbbc00c93061701e expref: 15 pid: 16043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.357380:0:14360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ec41 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c93061701e expref: 15 pid: 16043 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856028.357397:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400694780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14360:1874702486317696:192.168.201.38@tcp:104: 00000100:00100000:3.0:1787856028.357506:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73faa62480 going to sleep for 11 seconds 00000100:00100000:1.0:1787856028.360869:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856028.360907:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464316800 00000100:00100000:1.0:1787856028.360917:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464316800 00010000:00010000:1.0:1787856028.360967:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ec41 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c93061701e expref: 16 pid: 16043 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856028.361009:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 15 00000100:00100000:1.0:1787856028.361032:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d13792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+16:2357:x1874702464316800:12345-192.168.201.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787856028.361051:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787856028.361059:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ec41 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c93061701e expref: 16 pid: 16043 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.361074:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ec41 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c93061701e expref: 16 pid: 16043 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.361103:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a73cb5a9800) 00010000:00010000:1.0:1787856028.361110:0:14345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec79 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.361122:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec79 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.361131:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec79 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.361154:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787856028.361221:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d13792c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+16:2357:x1874702464316800:12345-192.168.201.38@tcp:103:ldlm_bl.0 Request processed in 190us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856028.361230:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 15 00010000:00010000:3.0:1787856028.361384:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5143000/0x516929ca3366ec41 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.38@tcp remote: 0xbbc00c93061701e expref: 15 pid: 16043 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856028.361404:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400694780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14360:1874702486317696:192.168.201.38@tcp:104: 00010000:00010000:3.0:1787856028.361431:0:14360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec79 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.361441:0:14360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec79 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.361447:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec79 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787856028.361699:0:14360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1787856028.361900:0:14360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1787856028.361954:0:14360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1787856028.362067:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400694780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14360:1874702486317824:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787856028.362321:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787856028.363672:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a73faa62600 going to sleep for 11 seconds 00000100:00100000:1.0:1787856028.363803:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486317824 00000100:00100000:1.0:1787856028.363815:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486317824 00000100:00100000:1.0:1787856028.363878:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787856028.363888:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400694b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14360:x1874702486317824:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787856028.364051:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400694b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14360:x1874702486317824:12345-0@lo:1000:mdt00_000.0 Request processed in 164us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856028.364069:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787856028.364325:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400694780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14360:1874702486317824:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787856028.365142:0:14360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1787856028.365244:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a7400694780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14360:1874702486317952:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787856028.365309:0:14360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787856028.365336:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c3307900 going to sleep for 11 seconds 00000100:00100000:1.0:1787856028.365485:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702486317952 00000100:00100000:1.0:1787856028.365491:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702486317952 00000100:00100000:1.0:1787856028.365546:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787856028.365557:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400696940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14360:x1874702486317952:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787856028.365990:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400696940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14360:x1874702486317952:12345-0@lo:1000:mdt00_000.0 Request processed in 432us (678us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787856028.366000:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787856028.366174:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a7400694780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14360:1874702486317952:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787856028.366221:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec79 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.366233:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec79 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.366254:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec79 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.366262:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337f800 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787856028.366268:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec79 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.366276:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec79 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.366297:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a73cb5a9800) 00010000:00010000:3.0:1787856028.366300:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787856028.366306:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec79 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.366313:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337f800/0x516929ca3366ec79 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.366365:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ebd1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.366372:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ebd1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.366379:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ebd1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.366385:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fec00 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:3.0:1787856028.366388:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ebd1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.366395:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ebd1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.366404:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:3.0:1787856028.366407:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787856028.366415:0:14360:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229800/0x516929ca3366ebd8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617002 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.366429:0:14360:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229800/0x516929ca3366ebd8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617002 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.366439:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229800/0x516929ca3366ebd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617002 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.366480:0:14360:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1229800/0x516929ca3366ebd8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.38@tcp remote: 0xbbc00c930617002 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856028.366512:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9a74006943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14360:1874702486318080:192.168.201.38@tcp:105: 00000100:00100000:3.0:1787856028.366590:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9a72c3307900 going to sleep for 11 seconds 00000100:00100000:0.0:1787856028.371655:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9a74006943c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14360:1874702486318080:192.168.201.38@tcp:105: 00010000:00010000:0.0:1787856028.371698:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ebd1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371712:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73fa6fec00/0x516929ca3366ebd1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16043 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371771:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142000/0x516929ca3366ec80 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371807:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142000/0x516929ca3366ec80 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371821:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142000/0x516929ca3366ec80 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371835:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142000/0x516929ca3366ec80 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371843:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142000/0x516929ca3366ec80 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371850:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142000/0x516929ca3366ec80 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371856:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73c5142000 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787856028.371860:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142000/0x516929ca3366ec80 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371868:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142000/0x516929ca3366ec80 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371907:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:0.0:1787856028.371911:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787856028.371915:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142000/0x516929ca3366ec80 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371920:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73c5142000/0x516929ca3366ec80 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371931:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371937:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec72 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371943:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371949:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337e600 already unused, calling callback (ffffffffc204f4f0) 00010000:00010000:0.0:1787856028.371952:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371958:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec72 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371966:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a73c7093000) 00010000:00010000:0.0:1787856028.371969:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787856028.371972:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec72 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.371977:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a72c337e600/0x516929ca3366ec72 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856028.372668:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+18:14494:x1874702464316672:12345-192.168.201.38@tcp:57:lhsmtool_posix.0 Request processed in 15833us (16341us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787856028.372682:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 53 00000020:00080000:0.0:1787856028.372690:0:14360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787856028.375480:0:14393:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787856028.375492:0:14393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787856028.375531:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787856028.375538:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00080000:1.0:1787856028.378016:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:1.0:1787856028.378044:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000100:00100000:0.0:1787856028.380199:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856028.380368:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856028.380522:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464317056 00000100:00100000:1.0:1787856028.380535:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464317056 00000100:00100000:2.0:1787856028.380604:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464317184 00000100:00100000:2.0:1787856028.380608:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464317184 00000100:00100000:2.0:1787856028.380647:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 10 00000100:00100000:2.0:1787856028.380659:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73c60f9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+19:14494:x1874702464317056:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787856028.381656:0:14363:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787856028.381766:0:14363:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787856028.382111:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ec87 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.382133:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ec87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.382147:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ec87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.382157:0:14363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ec87 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.382165:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ec87 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.382172:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ec87 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.382236:0:14363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787856028.382381:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73c60f9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+21:14494:x1874702464317056:12345-192.168.201.38@tcp:35:lhsmtool_posix.0 Request processed in 1719us (2192us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787856028.382393:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 10 00000020:00080000:2.0:1787856028.382410:0:14363:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787856028.382478:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 11 00000100:00100000:2.0:1787856028.382490:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1322580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+20:14493:x1874702464317184:12345-192.168.201.38@tcp:49:dd.0 00000100:00100000:2.0:1787856028.382574:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1322580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+20:14493:x1874702464317184:12345-192.168.201.38@tcp:49:dd.0 Request processed in 89us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787856028.382582:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 11 00010000:00010000:0.0:1787856028.388067:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787856028.388087:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ec87 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.388102:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228a00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856028.388108:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ec87 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.388120:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ec87 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.388146:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a73cb5a9800) 00010000:00010000:0.0:1787856028.388149:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787856028.388155:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ec87 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.388162:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a73d1228a00/0x516929ca3366ec87 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.391111:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856028.391121:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856028.391126:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787856028.541998:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787856028.574018:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856028.574242:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464317312 00000100:00100000:3.0:1787856028.574256:0:15049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464317312 00000100:00100000:3.0:1787856028.574344:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:3.0:1787856028.574356:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d137ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+6:2359:x1874702464317312:12345-192.168.201.38@tcp:4:dd.0 00002000:00010000:3.0:1787856028.574423:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a90849c, atime: 0x6a90849b, ctime: 0x6a90849c, blocks: 0x1 00010000:00010000:3.0:1787856028.574434:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000299475b1/0x516929ca3366ec8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.574455:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1787856028.574460:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856028.574467:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000299475b1/0x516929ca3366ec8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.574485:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000299475b1/0x516929ca3366ec8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787856028.577997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856028.578044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:0.0:1787856028.578321:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787856028.578335:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787856028.578409:0:15050:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787856028.578429:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464317440 00000100:00100000:2.0:1787856028.578440:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464317440 00000100:00100000:2.0:1787856028.578504:0:15050:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787856028.578510:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464317568 00000100:00100000:2.0:1787856028.578514:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464317568 00000100:00100000:2.0:1787856028.582724:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856028.582866:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856028.584307:0:15050:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787856028.584331:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464317696 00000100:00100000:3.0:1787856028.584340:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464317696 00000100:00100000:3.0:1787856028.584389:0:15050:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787856028.584395:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464317824 00000100:00100000:3.0:1787856028.584397:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464317824 00000100:00100000:1.0:1787856028.587638:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856028.587765:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856028.588516:0:15050:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787856028.588889:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:2.0:1787856028.588924:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464317952 00000100:00100000:2.0:1787856028.588934:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464317952 00000100:00100000:2.0:1787856028.589010:0:15050:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787856028.589017:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464318080 00000100:00100000:2.0:1787856028.589021:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464318080 00000100:00100000:2.0:1787856028.593494:0:16592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:2.0:1787856028.593517:0:16592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+13:2359:x1874702464317440:12345-192.168.201.38@tcp:4:dd.0 00010000:00010000:2.0:1787856028.593567:0:16592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceacf2e1/0x516929ca3366ec95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.593599:0:16592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856028.593611:0:16592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856028.593619:0:16592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ceacf2e1/0x516929ca3366ec95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.593644:0:16592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ceacf2e1/0x516929ca3366ec95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856028.594888:0:15050:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787856028.594904:0:15050:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1787856028.596636:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464318208 00000100:00100000:1.0:1787856028.596655:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464318208 00000100:00100000:3.0:1787856028.605245:0:16593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:3.0:1787856028.605272:0:16593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400696d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+15:2359:x1874702464317568:12345-192.168.201.38@tcp:4:dd.0 00010000:00010000:3.0:1787856028.608590:0:16593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366ec9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.608615:0:16593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856028.608620:0:16593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787856028.608637:0:16593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366ec9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787856028.608654:0:16593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366ec9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787856028.696499:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:1.0:1787856028.696519:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1787856028.701321:0:15049:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1787856028.701330:0:15049:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6147 00010000:00010000:2.0:1787856028.701344:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000299475b1/0x516929ca3366ec8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.701357:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000299475b1/0x516929ca3366ec8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.701366:0:15049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000299475b1/0x516929ca3366ec8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.701372:0:15049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337f800 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:2.0:1787856028.701378:0:15049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000299475b1/0x516929ca3366ec8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.701388:0:15049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000299475b1/0x516929ca3366ec8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.701409:0:15049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000299475b1/0x516929ca3366ec8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.701430:0:15049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000299475b1/0x516929ca3366ec8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856028.701515:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d137ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+18:2359:x1874702464317312:12345-192.168.201.38@tcp:4:dd.0 Request processed in 127157us (127510us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787856028.701526:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 0 00000100:00100000:2.0:1787856028.701561:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:2.0:1787856028.701572:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+17:2360:x1874702464317696:12345-192.168.201.38@tcp:4:dd.0 00010000:00010000:2.0:1787856028.701600:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039e0bac5/0x516929ca3366eca3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.701613:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856028.701618:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856028.701624:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039e0bac5/0x516929ca3366eca3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.701648:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039e0bac5/0x516929ca3366eca3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787856028.761570:0:16593:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1787856028.761580:0:16593:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6147 -> 6151 00010000:00010000:1.0:1787856028.761593:0:16593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366ec9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.761607:0:16593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366ec9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.761642:0:16593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366ec9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.761649:0:16593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a72c337fc00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787856028.761653:0:16593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366ec9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.761662:0:16593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366ec9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.761683:0:16593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366ec9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.761691:0:16593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3e5c058/0x516929ca3366ec9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856028.761829:0:16593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400696d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+19:2359:x1874702464317568:12345-192.168.201.38@tcp:4:dd.0 Request processed in 156564us (183778us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787856028.761843:0:16593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 2 00000100:00100000:1.0:1787856028.761873:0:16593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 4 00000100:00100000:1.0:1787856028.761886:0:16593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73f9dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+18:2359:x1874702464317824:12345-192.168.201.38@tcp:4:dd.0 00010000:00010000:1.0:1787856028.761932:0:16593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ecaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.761944:0:16593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856028.761955:0:16593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856028.761961:0:16593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ecaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.761973:0:16593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ecaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787856028.762350:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00010000:00010000:2.0:1787856028.767170:0:16592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ceacf2e1/0x516929ca3366ec95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.767190:0:16592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ceacf2e1/0x516929ca3366ec95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.767223:0:16592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ceacf2e1/0x516929ca3366ec95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.767230:0:16592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1229000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:2.0:1787856028.767235:0:16592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceacf2e1/0x516929ca3366ec95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.767244:0:16592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ceacf2e1/0x516929ca3366ec95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.767264:0:16592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ceacf2e1/0x516929ca3366ec95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.767272:0:16592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ceacf2e1/0x516929ca3366ec95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787856028.767378:0:16592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+14:2359:x1874702464317440:12345-192.168.201.38@tcp:4:dd.0 Request processed in 173865us (189391us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787856028.767388:0:16592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 1 00000100:00100000:2.0:1787856028.767419:0:16592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:2.0:1787856028.767431:0:16592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1379a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+13:2359:x1874702464317952:12345-192.168.201.38@tcp:4:dd.0 00010000:00010000:2.0:1787856028.767462:0:16592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfd4f2c7/0x516929ca3366ecb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.767474:0:16592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856028.767484:0:16592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787856028.767491:0:16592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfd4f2c7/0x516929ca3366ecb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787856028.767505:0:16592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfd4f2c7/0x516929ca3366ecb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787856028.856848:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1787856028.858284:0:15049:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:1.0:1787856028.858293:0:15049:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1787856028.858309:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039e0bac5/0x516929ca3366eca3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.858323:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039e0bac5/0x516929ca3366eca3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.858332:0:15049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039e0bac5/0x516929ca3366eca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.858338:0:15049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228e00 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787856028.858343:0:15049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039e0bac5/0x516929ca3366eca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.858352:0:15049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039e0bac5/0x516929ca3366eca3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.858371:0:15049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039e0bac5/0x516929ca3366eca3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.858396:0:15049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039e0bac5/0x516929ca3366eca3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856028.858483:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+15:2360:x1874702464317696:12345-192.168.201.38@tcp:4:dd.0 Request processed in 156910us (275773us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787856028.858493:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 3 00000100:00100000:1.0:1787856028.858525:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 6 00000100:00100000:1.0:1787856028.858536:0:15049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1378780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+14:2359:x1874702464318080:12345-192.168.201.38@tcp:4:dd.0 00010000:00010000:1.0:1787856028.858574:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082fa68d7/0x516929ca3366ecb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.858587:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856028.858592:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856028.858599:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082fa68d7/0x516929ca3366ecb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.858611:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082fa68d7/0x516929ca3366ecb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787856028.936391:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:1.0:1787856028.936500:0:16592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1787856028.936505:0:16592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:1.0:1787856028.936519:0:16592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfd4f2c7/0x516929ca3366ecb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.936531:0:16592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfd4f2c7/0x516929ca3366ecb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.936554:0:16592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfd4f2c7/0x516929ca3366ecb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.936561:0:16592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73d1228000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787856028.936566:0:16592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfd4f2c7/0x516929ca3366ecb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.936575:0:16592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfd4f2c7/0x516929ca3366ecb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.936595:0:16592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfd4f2c7/0x516929ca3366ecb1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.936603:0:16592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfd4f2c7/0x516929ca3366ecb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856028.936709:0:16592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1379a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+12:2359:x1874702464317952:12345-192.168.201.38@tcp:4:dd.0 Request processed in 169277us (349092us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787856028.936725:0:16592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 5 00000100:00100000:1.0:1787856028.936757:0:16592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 7 00000100:00100000:1.0:1787856028.937084:0:16592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a73d1379e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+11:2359:x1874702464318208:12345-192.168.201.38@tcp:4:dd.0 00010000:00010000:1.0:1787856028.937121:0:16592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000594aba77/0x516929ca3366ecbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.937133:0:16592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856028.937143:0:16592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787856028.937150:0:16592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000594aba77/0x516929ca3366ecbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.937162:0:16592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000594aba77/0x516929ca3366ecbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787856028.945411:0:16593:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:0.0:1787856028.945449:0:16593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ecaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.945462:0:16593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ecaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.945471:0:16593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ecaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.945478:0:16593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe600 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856028.945483:0:16593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ecaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.945491:0:16593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ecaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.945511:0:16593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ecaa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.945519:0:16593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7b56acd/0x516929ca3366ecaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856028.945616:0:16593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73f9dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+13:2359:x1874702464317824:12345-192.168.201.38@tcp:4:dd.0 Request processed in 183729us (362744us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1787856028.945636:0:16593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 4 00000001:00080000:2.0:1787856028.991294:0:7628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:1.0:1787856028.991673:0:16592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:1.0:1787856028.991688:0:16592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000594aba77/0x516929ca3366ecbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.991702:0:16592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000594aba77/0x516929ca3366ecbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.991712:0:16592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000594aba77/0x516929ca3366ecbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.991731:0:16592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6fe200 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:1.0:1787856028.991736:0:16592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000594aba77/0x516929ca3366ecbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.991755:0:16592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000594aba77/0x516929ca3366ecbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.991801:0:16592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000594aba77/0x516929ca3366ecbf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787856028.991811:0:16592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000594aba77/0x516929ca3366ecbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787856028.991915:0:16592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1379e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+7:2359:x1874702464318208:12345-192.168.201.38@tcp:4:dd.0 Request processed in 55145us (403022us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787856028.991925:0:16592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 7 00010000:00010000:0.0:1787856028.994587:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082fa68d7/0x516929ca3366ecb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.994639:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082fa68d7/0x516929ca3366ecb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.994649:0:15049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082fa68d7/0x516929ca3366ecb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.994656:0:15049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a73fa6ff000 already unused, calling callback (ffffffffc15ff440) 00010000:00010000:0.0:1787856028.994660:0:15049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082fa68d7/0x516929ca3366ecb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.994670:0:15049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082fa68d7/0x516929ca3366ecb8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.994690:0:15049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082fa68d7/0x516929ca3366ecb8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787856028.994698:0:15049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082fa68d7/0x516929ca3366ecb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787856028.995162:0:15049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a73d1378780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2359:x1874702464318080:12345-192.168.201.38@tcp:4:dd.0 Request processed in 136623us (407389us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787856028.995173:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 6 00010000:00010000:0.0:1787856029.563887:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856030.592748:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787856030.637268:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856030.637314:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856030.637350:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856030.637382:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856030.637399:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856030.637414:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464318592 00000100:00100000:3.0:1787856030.637420:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:1.0:1787856030.637423:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464318592 00000100:00100000:3.0:1787856030.637439:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.38@tcp (source: 12345-192.168.201.38@tcp) 00000100:00100000:3.0:1787856030.637458:0:16043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464318848 00000100:00100000:3.0:1787856030.637462:0:16043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464318848 00000100:00100000:1.0:1787856030.637472:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464319104 00000100:00100000:1.0:1787856030.637474:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464319104 00000100:00100000:1.0:1787856030.637486:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464318720 00000100:00100000:1.0:1787856030.637489:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464318720 00000100:00100000:3.0:1787856030.637490:0:16043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464318464 00000100:00100000:3.0:1787856030.637492:0:16043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464318464 00000100:00100000:1.0:1787856030.637500:0:15044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464318976 00000100:00100000:1.0:1787856030.637502:0:15044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464318976 00000100:00100000:1.0:1787856030.637515:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:1.0:1787856030.637523:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400697c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2359:x1874702464318592:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787856030.637524:0:16043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:3.0:1787856030.637529:0:16043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400695680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c263b399-c1aa-429f-9204-78dc9c713772+6:2359:x1874702464318848:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787856030.637590:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400697c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2359:x1874702464318592:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 66us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856030.637608:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 19 00000100:00100000:2.0:1787856030.637622:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:2.0:1787856030.637630:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400696580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+20:2359:x1874702464318464:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:1.0:1787856030.637635:0:15044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 20 00000100:00100000:1.0:1787856030.637640:0:15044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a7400695e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c263b399-c1aa-429f-9204-78dc9c713772+5:2359:x1874702464319104:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787856030.637681:0:16043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400695680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c263b399-c1aa-429f-9204-78dc9c713772+6:2359:x1874702464318848:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 150us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856030.637688:0:16043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 28 00000100:00100000:3.0:1787856030.637724:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:3.0:1787856030.637732:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2359:x1874702464318720:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787856030.637769:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006952c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+5:2359:x1874702464318720:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 38us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856030.637803:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 21 00000100:00100000:3.0:1787856030.637816:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:3.0:1787856030.637822:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a74006961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c263b399-c1aa-429f-9204-78dc9c713772+5:2359:x1874702464318976:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:3.0:1787856030.637845:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a74006961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c263b399-c1aa-429f-9204-78dc9c713772+5:2359:x1874702464318976:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 23us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856030.637850:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 22 00000100:00100000:0.0:1787856030.638042:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874702464318336 00000100:00100000:0.0:1787856030.638054:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874702464318336 00000100:00100000:0.0:1787856030.638091:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.38@tcp, seq: 122 00000100:00100000:0.0:1787856030.638098:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a72c3300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+13:2359:x1874702464318336:12345-192.168.201.38@tcp:400:kworker.0 00000100:00100000:0.0:1787856030.638131:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a72c3300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc66c119-c344-45de-bbb7-cac8e3170df7+13:2359:x1874702464318336:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 33us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787856030.638137:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 122 00000100:00080000:0.0:1787856030.642313:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787856030.642324:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787856030.642327:0:14356:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787856030.646527:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400696580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae33b44f-c9e3-446c-bea8-6bb64f60aa30+20:2359:x1874702464318464:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 8882us (9111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787856030.646543:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 29 00000100:00100000:1.0:1787856030.656071:0:15044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a7400695e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c263b399-c1aa-429f-9204-78dc9c713772+5:2359:x1874702464319104:12345-192.168.201.38@tcp:400:kworker.0 Request processed in 18417us (18675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787856030.656087:0:15044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.38@tcp, seq: 20 00000001:02000400:0.0:1787856030.818825:0:16631:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787856031.612133:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787856032.637491:0:16051:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29569 lines, 29569 kept, 0 dropped, 0 bad.